Trajectory processing and post-processing saved to disk.

Before opening a new issue, we wanted to provide you with some useful suggestions (Click "Preview" above for a better view):

Consider checking out SDK examples.
Have you looked in our documentations?
Is you question a frequently asked one?
Try searching our GitHub Issues (open and closed) for a similar issue.

All users are welcomed to report bugs, ask questions, suggest or request enhancements and generally feel free to open new issue, even if they haven't followed any of the suggestions above :)

Required Info

Camera Model
D445}

Firmware Version
<IP_ADDRESS>

Operating System & Version
{Win 10

Kernel Version (Linux Only)
NA

Platform
PC

SDK Version
<IP_ADDRESS>81

Language
{C/C++

Segment
imaging plus depth measures

Issue Description
Now that the imu data (linear and gyro accelerations) are available via rs-convert, computation of trajectories is possible given some initial condition inputs. There are a number of programs in the SDK tools and sample programs for trajectory but they appear to be for specific conditions (such as T265 pose stream) and outputs primarily for screen display and not for saving the trajectory to a file.
Are there any programs within the SDK tools and samples that I may have missed for generating and saving a trajectory in real-time for the D455 camera or post-processing a bag file for the D455 pose stream to generate and save the trajectory given initial condition inputs?
Do you know of any good code or pseudo-code (and documentation) outside of the SDK tools and samples for computing trajectories? I have found one thesis with code similar to that found in rs-trajectory based on using the Quaternion method.
Again thank you for your assistance.

Hi @jimmek   Although it is more complex to implement than the rs-trajectory example for T265, a RealSense user has published an adaptation of Intel's official D435i SLAM guide for ROS.  The adaptation expands upon the concept of the original guide to demonstrate how to add path tracking and draw the trajectory from position data with matplotlib.
https://shinkansan.github.io/2019-UGRP-DPoom/SLAM

Hello MartyG,
Thank you for comment.  I have looked at some of the references you provided for trajectory computation. As you said, they do look to be more complex to implement. I think the best approach for trajectory computation may be post-processing as the imu data is now available via rs-convert. Do you know of any other good code or pseudo-code (and documentation) for trajectory computation? As I mention in the previous comment, I did find one thesis with code similar to that found in rs-trajectory that was based on using the Quaternion method. Do you or your colleagues know of any other sources?
Thank you for your time and assistance.

Was the quaternion-using paper that you saw the one in the link below that was published in May 2021 and uses a RealSense D455 to compute the camera trajectory?
https://www.mdpi.com/2071-1050/13/10/5585/htm
Another paper, meanwhile, uses backward trajectory post-processing with two D455 cameras.
https://www.mdpi.com/2072-4292/13/16/3099/htm

An existing platform that may also fit your needs is SLAMcore ( https://www.slamcore.com/ ), which is compatible with RealSense D435i and D455.  An article on the official RealSense blog about SLAMcore can be found in the link below.
https://www.intelrealsense.com/slamcore/
Real-time position estimate

Hi @jimmek  Do you require further assistance with this case, please?  Thanks!

Case closed due to no further comments received.


just_audio upgrade issues

just_audio causes issues after upgrading
A direct build without any changes could not complete with several build errors stating ios build version differences. So I went ahead and upgraded all the individual packages.
To Reproduce
Steps to reproduce the behaviour:

Updated the pubspec yaml with the latest versions of the packages used (versions shown below)
Compile errors are shown within the 'mobile_audio_player.dart' file

Expected behaviour
Should have hopefully built with the latest packages.
Screenshots

Smartphone (please complete the following information):

Device: Simulator (iPhone 12 Pro - iOS 14.3)
OS: iOS 14.3

Additional context
`environment:
sdk: ">=2.8.0 <3.0.0"
dependencies:
flutter:
sdk: flutter
flutter_localizations:
sdk: flutter
audio_service: ^0.16.1
cached_network_image: ^2.5.0
connectivity: ^2.0.2
cupertino_icons: ^0.1.2
flutter_dialogs: ^1.1.0
flutter_downloader: ^1.5.2
flutter_launcher_icons: ^0.8.1
flutter_spinkit: ^4.1.2+1
html: ^0.14.0+4
intl: ^0.16.1
intl_translation: ^0.17.10+1
just_audio: ^0.6.5
liquid_pull_to_refresh: ^2.0.0
logging: ^0.11.4
mockito: ^4.1.3
mp3_info: ^0.1.4
package_info: ^0.4.3+2
path_provider: ^1.6.27
percent_indicator: ^2.1.9
permission_handler: ^5.0.1+1
podcast_search: ^0.3.7
provider: ^4.3.2+3
rxdart: ^0.25.0
sembast: ^2.4.8+1
shared_preferences: ^0.5.12+4
url_launcher: ^5.7.10
dev_dependencies:
flutter_test:
sdk: flutter
pedantic: ^1.9.2`
Pastebin - initial build error

Hi,
iOS support is still work in progress; however, I do have a set of changes - currently sat in the feature/ios branch - that produces a successful build for iOS (via CI). I will be merging these into master this week, but if you would like to check out the branch and let me know if it builds successfully for you that would be great.
The just_audio and audio_service packages are under very active development and there are a couple of breaking changes in recent releases: 0.6.0 in just_audio and 0.14.0 in audio_service. There are a number of dependencies that have become out of date whilst I have concentrated on stability improvements and bug fixes, but I intend to address these next.

Hi,
iOS support is still work in progress; however, I do have a set of changes - currently sat in the feature/ios branch - that produces a successful build for iOS (via CI). I will be merging these into master this week, but if you would like to check out the branch and let me know if it builds successfully for you that would be great.
The just_audio and audio_service packages are under very active development and there are a couple of breaking changes in recent releases: 0.6.0 in just_audio and 0.14.0 in audio_service. There are a number of dependencies that have become out of date whilst I have concentrated on stability improvements and bug fixes, but I intend to address these next.

Oooh, that branch was so close :) It builds and installs and then a run time error:
Launching lib/main.dart on iPhone 12 Pro in debug mode...
lib/main.dart:1
Xcode build done.                                           24.9s
Connecting to VM Service at ws://<IP_ADDRESS>:58521/UCph8vRw6vA=/ws
flutter: FINE: - 2021-01-10 17:31:10.487085: Chrome: transparentLight()
Lost connection to device.
Exited (sigterm)

Oooh, that branch was so close :) It builds and installs and then a run time error:
Launching lib/main.dart on iPhone 12 Pro in debug mode...
lib/main.dart:1
Xcode build done.                                           24.9s
Connecting to VM Service at ws://<IP_ADDRESS>:58521/UCph8vRw6vA=/ws
flutter: FINE: - 2021-01-10 17:31:10.487085: Chrome: transparentLight()
Lost connection to device.
Exited (sigterm)

Yes, I am finding the same issue. Frustratingly, it builds and installs but then looses connection to the device as the app starts. I will do some investigating.

Yes, I am finding the same issue. Frustratingly, it builds and installs but then looses connection to the device as the app starts. I will do some investigating.

Do you think this is because some plugins need user permissions and that is not set yet?

Do you think this is because some plugins need user permissions and that is not set yet?

If it helps, the crash occurs in "mobile_download_service.dart" line 40.
/// An implementation of a [DownloadService] that handles downloading
/// of episodes on mobile.
class MobileDownloadService extends DownloadService {
  static BehaviorSubject<DownloadProgress> downloadProgress = BehaviorSubject<DownloadProgress>();

  final log = Logger('MobileDownloadService');

  @override
  final Repository repository;
  final ReceivePort _port = ReceivePort();

  MobileDownloadService({@required this.repository}) : super(repository: repository) {
    _init();
  }

If it helps, the crash occurs in "mobile_download_service.dart" line 40.
/// An implementation of a [DownloadService] that handles downloading
/// of episodes on mobile.
class MobileDownloadService extends DownloadService {
  static BehaviorSubject<DownloadProgress> downloadProgress = BehaviorSubject<DownloadProgress>();

  final log = Logger('MobileDownloadService');

  @override
  final Repository repository;
  final ReceivePort _port = ReceivePort();

  MobileDownloadService({@required this.repository}) : super(repository: repository) {
    _init();
  }

When re-creating some of the iOS files I missed adding support for the sqlite library required by flutter_downloader. I have pushed a fix to the iOS branch, so the app will now compile and run. iOS support is still very much work in progress whilst the app now runs it still does not work correctly. There is a little way to go until I can release a polished version of Anytime for iOS - but definitely it's getting there.

When re-creating some of the iOS files I missed adding support for the sqlite library required by flutter_downloader. I have pushed a fix to the iOS branch, so the app will now compile and run. iOS support is still very much work in progress whilst the app now runs it still does not work correctly. There is a little way to go until I can release a polished version of Anytime for iOS - but definitely it's getting there.

I noticed, I figured out the changes and was about to make a push only to realise you beat me to it :)

I noticed, I figured out the changes and was about to make a push only to realise you beat me to it :)

I'm not sure what is causing the error shown in your screenshot - it should work fine on Android - indeed I use in on Android daily. Is it not populating the discovery tab there?

I'm not sure what is causing the error shown in your screenshot - it should work fine on Android - indeed I use in on Android daily. Is it not populating the discovery tab there?

yeah, discovery is not populating
I am not creating another issue yet, will restart the laptop in a while and then try again. and keep you posted.
Any chance you will be merging the ios branch to master?

yeah, discovery is not populating
I am not creating another issue yet, will restart the laptop in a while and then try again. and keep you posted.
Any chance you will be merging the ios branch to master?

Yes, I'm happy the iOS changes does not break anything so I will merge to master later today.

Yes, I'm happy the iOS changes does not break anything so I will merge to master later today.

I have merged the changes to master and deleted the feature/ios branch.

I have merged the changes to master and deleted the feature/ios branch.


what about double / path in the router?

Hi,
in the project i see, in the router.js file,
two object of route inside the routing array.

what is this?
i'm not able to read anything about this in the documentation
how it should work?
thanks

Hi there,
We've released a newer version of the product and all of the issues are fixed.
All the best,
Sajad


I need more information (auth endpoint / token endpoint)

I need more information (auth endpoint / token endpoint)

Please reopen this with some details, if this is still relevant


Support same PHP versions as Laravel 6.x

With this requirement, Inertia Laravel will be satisfied by the same PHP version as Laravel >6. It also allows new developers to use PHP 8.3 (RC currently)
inertiajs/inertia-laravel v0.6.9 requires php ^7.2|~8.0.0|~8.1.0|~8.2.0 -> your php version (8.3.0RC1) does not satisfy that requirement.

Well #540 might be more interesting by just adding the PHP 8.3 version

Thanks! Given that PHP doesn't follow semver, I think it's probably safer to go with #540.


Zephyr standalone platform update

As discussed in #33471 and #33777, the purpose of this PR is to leave open the possibility of using the Zephyr platform as a standalone platform, working with any boards present in Zephyr (which has network connectivity, enough flash, etc...). For testing purposes, I use a nucleo h563zi. This standalone platform should be used for manufacturers working on Zephyr, but also for people which would like to implement Matter in an unsupported board, using Zephyr OS. This zephyr "module" should simplify developer's life on the Zephyr platform.
Currently, zephyr platform can't be used in a Zephyr ecosystems without modifications, that's why I made that. My guess is anybody which has his board into Zephyr, like ESP or ST, could use the zephyr standalone platform to develop a product. With this, it is not mandatory to use a specific manufacturer zephyr sdk.
It would be great to also develop an example (like lighting-app) which work for the Zephyr SDK, but my knowledge on the Matter stack are very limited currently.
To sum-up, this PR make changes in order to have a functional connectedhomeip, as a Zephyr sdk module.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

It seems that remove ZephyrSocket.h, which implemented recvmsg function before zephyr implemented it, is still used in many examples. Should I put ZephyrSocket.h back ?

It seems that remove ZephyrSocket.h, which implemented recvmsg function before zephyr implemented it, is still used in many examples. Should I put ZephyrSocket.h back ?

Oh yes, please. Just set CHIP_SYSTEM_CONFIG_USE_ZEPHYR_SOCKET_EXTENSIONS to 0 for Zephyr platform if needed.

@Damian-Nordic is there a clean way to put Zephyr socket back (like undo the f283940 commit) ?

Hi @QuentinCaldeira-eaton
First of all Thanks for filing this PR, I want to try Matter on ESP using Zephyr, and Luckily this PR came in right at the time for me.
I have followed the steps mentioned here https://github.com/project-chip/connectedhomeip/issues/33471. But i was not able to compile it for ESP.
Following are the steps

included your fork in yaml file as per https://github.com/project-chip/connectedhomeip/issues/33471
I have moved config/zephyr/chip-module
Changed paths in Kconfig, and CMakeLists.
added CONFIG_CHIP=y

Following is the error I'm getting.
[325/342] Performing build step for 'chip-gn'Starting Matter library build in D:/ZephyrApps/bfw/build/modules/connectedhomeip
diff: args.gn: No such file or directory
ERROR at //third_party/pigweed/repo/pw_toolchain/clang_tools.gni:15:1: Unable to load "D:/ZephyrApps/modules/lib/matter/build_overrides/pigweed_environment.gni".
import("//build_overrides/pigweed_environment.gni")
^-------------------------------------------------
See //third_party/pigweed/repo/pw_toolchain/host_clang/toolchains.gni:18:1: whence it was imported.
import("$dir_pw_toolchain/clang_tools.gni")
^-----------------------------------------
See //third_party/pigweed/repo/pw_unit_test/test.gni:22:1: whence it was imported.
import("$dir_pw_toolchain/host_clang/toolchains.gni")
^---------------------------------------------------
See //third_party/pigweed/repo/pw_string/BUILD.gn:21:1: whence it was imported.
import("$dir_pw_unit_test/test.gni")
^----------------------------------
See //src/lib/core/BUILD.gn:118:5: which caused the file to be included.
    "$dir_pw_string",

Let me know if i missed any step, or you could help me here. It will be really helpful

Hey @biii-anuj-pathak, I don't if it's the right place to discuss this, but here are the first things I think of.

Did you clone the submodules as well (like pigweed, jsoncpp, etc...). You can do this with git submodule update --recursive
Did you bootstrap after git clone ? It's mandatory
Did you source scripts/activate.sh before building ?

By the way, if I can see the example you are building, it will help me to test this PR.
Tell me if it helps you !

Hi @Damian-Nordic, I don't understand why nrf build doesn't pass. Any idea ?

@QuentinCaldeira-eaton Most likely because you added #include <zephyr/net/net_if.h> to the common code without checking if Zephyr net_if usage is enabled in Matter (which in fact is not enabled for native_posix tests).
You can guard the include with #if CHIP_DEVICE_CONFIG_ENABLE_WIFI and it should help.

@QuentinCaldeira-eaton Most likely because you added #include <zephyr/net/net_if.h> to the common code without checking if Zephyr net_if usage is enabled in Matter (which in fact is not enabled for native_posix tests).
You can guard the include with #if CHIP_DEVICE_CONFIG_ENABLE_WIFI and it should help.

Seems to the trick, thanks ! Now Darwin platform causing trouble. I don't if it's alarming or not.

@Damian-Nordic, I don't understand why Darwin failed. Any idea ?

Hi,
Could you give us (NXP) some time to review this PR ? We are also using zephyr with matter but we don't have workflows setup yet (coming soon, we are working on it). So we just need to check if it's ok on our end.
Thanks !

@axelnxp Yes, of course. Do I need to do something else or everything is okay ?

@QuentinCaldeira-eaton looks good to us, you can go ahead, thanks !

@axelnxp Thanks ! I'm just waiting for approval. If one day you have some time, could I discuss with you about Matter with Zephyr ?


Dependency management

I looked into different dependency management tools for python and I found three alternatives: poetry, pipenv and pip-compile (from the package pip-tools).
As I compared them I found that poetry and pipenv try to be a solution for everything, creating environments, packages and doing dependency managements. A nice feature of pipenv is that it also looks into security vulnerabilities of the packages. However, pipenv is only very inconsistently updated and to me the current status of the project is not entirely clear.
Therefore, I found a nice and easy solution would be to use pip-compile. It generates a pinned/freezed requirements.txt file from a requirements.in (which is unpinned), so the pinned versions can be easily updated. You may also generate the requirements.txt directly from the setup.py requirements (but for nomad-parser they are just read from requirements.txt, so this is not a viable solution here). The changes from the current state would be minimal but it would freeze the whole dependency tree and would certainly solve dependency issues which keep appearing for us.
We started to use it in our ellipsometry tool, so here you can see some example files for a base installation and two extra requires dependencies (of the form {extra}-requirements.txt).
@shabihsherjeel @sanbrock @aalbino2 @mkuehbach  What do you think? We may shortly discuss after DSM tomorrow.
Edit: I forgot, that there is also pip-sync to sync the dependency tree again. I don't know what the difference from a pip install -r requirements.txt would be, because I did not test it out. However, they do promote it to build reproducible environments in i.e. docker containers.

There are already things rolling within nomad on using pip-compile: https://gitlab.mpcdf.mpg.de/nomad-lab/nomad-FAIR/-/issues/934#note_143261
I think we should just follow and adapt their scheme for us.

The mypy test fails for us now:
https://github.com/nomad-coe/nomad-parser-nexus/actions/runs/3070223814/jobs/4959732535
This is also related I think. This breaks because of incompatibilty with our xarray version. We have set it to xarray==0.19.0. But it could be that the order of the packages in our requirements.txt changes this. This same combo of xarray==0.19.0 and mypy==0.750 works on the Nomad CI. There, I believe the electronics parser downgrades mypy to 0.730 before mypy is actually executed.  I'm guessing that's why we see this inconsistent behavior between the two CI's.


Finish configurator editor new UI

[x] Move interactive filters "in place"
[x] Only the chart type and the chart options should be expanded by default and the other sections collapsed

Originally posted by @ptbrowne in https://github.com/visualize-admin/visualization-tool/issues/829#issuecomment-1307384350

functionality LGTM!
@ptbrowne i noticed that some translations are missing:
DE-> it appears the key is not yet defined
In FR, IT and ENG it just shows "interactive" i am wondering if this is clear enough? Maybe "activate interactive filters" or "add interactive filters" would be more clear? (translated respectively for each locale)

I think that "activate interactive filters" is a bit too long, but I agree that only "interactive" is a bit short, maybe we could have a tooltip on the toggle with more information ? @AnninaWalker ?

Could we maybe label it "Add interactivity" instead of only "Interactive" and then on top of that as you have suggested @ptbrowne add a tooltip with some further explanation? Something like. Add interactivity to your visualizations by allowing the endusers to filter your visualizations.

Can be viewed on test.


PR template with emphasis on testing

Related to https://github.com/meroxa/product/issues/647

@janelletavares since this is a public fork, I'm not sure that this template fits, since we may not want to encourage posting screenshots / demos of platform internals.
Perhaps we should just do this in the infra repo where it's referenced. Thoughts?


Documentation not clear for beginners

I tried to use this plug-in for my site but I must be missing something because I couldn't get it to work.
I spent hours searching the internet for answers all in vain.
A tutorial or full example for at least one archive type, say category-archive, would be appreciated.

I turns out my problem had to do with the fact that Github pages doesn't support this plug-in.
This is unfortunate, because from what I have read so far, jekyll-archives is a great time saver.
For now, I will go with this solution: http://mrloh.se/2015/06/automatic-archives-for-jekyll-on-github-pages/

You can try leaving a request to have this plugin whitelisted for GitHub Pages by opening a ticket at the gem's repo and by sending a request to GitHub Support


qcheck-stm should filter out functions with ghost arguments or results

Given the following interface:
type 'a t
(*@ model size : int
    mutable model contents : 'a list *)

val make : int -> 'a -> 'a t
(*@ t = make i a
    checks i >= 0
    ensures t.size = i
    ensures t.contents = List.init i (fun j -> a) *)

val length : 'a t -> int
(*@ i = length [j: int] t
    ensures i = j *)

ortac qcheck-stm array.mli "make 16 'a'" "char t" happily generates the following postcond, in which j is never bound:
    let postcond cmd__004_ state__005_ res__006_ =
      let new_state__007_ = lazy (next_state cmd__004_ state__005_) in
      match (cmd__004_, res__006_) with
      | (Length, Res ((Int, _), i)) -> i = j
      | _ -> true

The issue is deeper than just the qcheck-stm plugin. The wrapper will happily generate calls to length j t in the same setting.
We should also consider how to deal with the case in which a function with ghost arguments is marked as pure and is therefore available in other specifications.

Closed by #118.


Add --config option to the join command

Is your feature request related to a problem? Please describe.
Let's say I have 3 open API YAML files that belong to a single project. I need to combine all of them then I need to generate single HTML documentation for the entire project.
Describe the solution you'd like
Add --config option to the join command similar to the bundle command.
Under API definitions of the config file .redocly.yaml we can have the paths to each file that need to be joined.
Describe alternatives you've considered
None.
Additional context
None.

I think it makes sense to allow the user to specify a config file, but that the API names/files to join should still be supplied to the command. Joining everything in the config file is probably not what a user intended in most cases.

Has been implemented in scope of https://github.com/Redocly/redocly-cli/pull/1136.


Changes to support search for associations with target names provided.

changes to associations.py mostly to be able to lookup the target id-s based on target name and also to take into an account the 'format' parameter that is being sent from rest_api. This is also not ready to be merged, but created pull request for convenience.
@apierleoni @emepyc

@apierleoni @elipapa Can we merge this pull request? Is there anything outstanding here?


gitignore: Add a few lines following an upstream change

This change has been getting applied by flutter run, and Greg identified this upstream commit as the cause:
https://github.com/flutter/flutter/commit/29f332c82
Discussion:
https://github.com/zulip/zulip-flutter/pull/873#issuecomment-2285235234

LGTM, thanks — please go ahead and merge.
Based on that upstream commit, I expect this change gets applied any time you build or run the app for iOS or macOS.


Add support for #booking_datetime and #value_datetime

I just stumbled upon a camt.053 statement that had a booking datetime value instead of a booking date.
This PR adds support for Entry#booking_datetime and Entry#value_datetime while also returning nil for Entry#booking_date and Entry#value_date if these attributes are empty. This makes it possible to simply check for nil when otherwise Date.parse(nil) would have thrown an ArgumentError.
For example:
booking_date = entry.date || entry.datetime&.to_date

Hi @danielpuglisi, thank you for the contribution.
I will take another look hopefully in the next few days, but it seems reasonable


repostary page help button overlap form

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to SOS Report
notice help button overlap input form
*Expected behavior
Screenshots

Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Additional context
this appear on devices from 1250 px to 400px so its applied to phones as well i think

Allow me to make a quick tiny small fix to it  please


Linking against zlib's static version instead of dynamic.

why exactly do we wanna do this? I thought we didn't want to link in any third party dependencies.
For C#, compiling this statically would mean dropping the dependency on https://www.nuget.org/packages/grpc.dependencies.zlib/, so this PR is incomplete.

Looking at this old abandoned pull request, it looks like the zlib static linkage made it to upstream/master (see #2709) through some backdoor, because I haven't LGTMd it ;-)

it got put in with #2506 in order to get tests to compile, see templates/vsprojects/vcxproj_defs.include.  Do you want it turned off on non-test items?

Is this dead?

I think so. Closing.


[docs] Document browser support

Hii,
what are the browsers supported ? is IE supported?,

I had the same question. By the way, do you cross browser test it?

@rxaviers we don't specifically test it on every browser before releasing -- but if anything breaks with a particular browser, people report it fairly quickly and it gets fixed. So I think it's safe to say that MUI should work on most modern browsers.
With that being said, I'll be closing this issue for now. If you notice any browser-specific issues, feel free to open a new issue.

Material-ui is a fantastic design. It would be good if it was reliable cross browsers, cross environments.
A quick test shows:
Grid list (demo) doesn't show up well on:

Safari 8, OS X Yosemite:

IE 10, Windows 8:

Edge 12, Windows 10: (note the scroll bars, not sure if anything could be done about it)

Date picker (demo) doesn't open at all on:

Safari 8, OS X Yosemite.
Safari, iOS 9.
IE 10, Windows 8.

Date picker (demo) has an interesting full-page-blink on Edge 12, Windows 10:

@rxaviers wow, thanks for testing this so thoroughly! Now that we have this info, I'll be opening a separate issue for each of these browsers..

@rxaviers Heads up, GridList works in Edge 14.

@jdalton thanks for the update. :)


[release-1.23] Traefik Installation not totally reloaded after a HelmChartConfig removal

Backport to branch release-1.23:

#5534

Environment Details

Infrastructure

[x] Cloud (AWS)
[ ] Hosted

Node(s) CPU architecture, OS, and Version:

Ubuntu 20.04 LTS
Cluster Configuration:

3 servers
1 agent

Config.yaml:
N/A
Replication Steps

Install K3S using v1.23.7+k3s1
Ensure everything is up and running, and traefik service maps to ports 80 and 443
After everything is up and running, apply helmchartconfig: kubectl apply -f k3s-helmchartconfig.yaml:

# k3s-helmchartconfig.yaml
apiVersion: helm.cattle.io/v1
kind: HelmChartConfig
metadata:
  name: traefik
  namespace: kube-system
spec:
  valuesContent: |-
    ports:
      web:
        exposedPort: 1234
      websecure:
        exposedPort: 5555

Ensure the traefik helm job reruns (pod recreates) and after it completes, the traefik service ports have updated:

NAMESPACE     NAME                     TYPE           CLUSTER-IP      EXTERNAL-IP              PORT(S)                         AGE   SELECTOR

kube-system   service/traefik          LoadBalancer   <IP_ADDRESS>   <redacted>               1234:31100/TCP,5555:32586/TCP   43m   app.kubernetes.io/instance=traefik,app.kubernetes.io/name=traefik

Delete the helmchartconfig: kubectl delete -f k3s-helmchartconfig.yaml

Results:

After deleting the helmchartconfig, the traefik helm job should rerun again and the traefik service ports should have been updated back to 80 and 443. They were not.
Validation Steps

Perform the same steps as in replication, but using release-1.23 branch commitid 4dda76b0a9870a6724a3c0846578384380c430d6
Results:

Initial state:

NAMESPACE     NAME                     TYPE           CLUSTER-IP      EXTERNAL-IP            PORT(S)                      AGE   SELECTOR
kube-system   service/traefik          LoadBalancer   <IP_ADDRESS>   <redacted>             80:31100/TCP,443:32586/TCP   41m   app.kubernetes.io/instance=traefik,app.kubernetes.io/name=traefik

After applying helmchartconfig:

$ k apply -f k3s-helmchartconfig.yaml
helmchartconfig.helm.cattle.io/traefik created

# Notice Age on helm-install-traefik pod:
kube-system   pod/helm-install-traefik-crd-tbqvd            0/1     Completed   0          43m   <IP_ADDRESS>   ip-172-31-12-149   <none>           <none>
kube-system   pod/helm-install-traefik-j8mz2                0/1     Completed   0          69s   <IP_ADDRESS>   ip-172-31-15-173   <none>           <none>
kube-system   pod/local-path-provisioner-6c79684f77-7nqbn   1/1     Running     0          43m   <IP_ADDRESS>   ip-172-31-12-149   <none>           <none>

# Change accepted
NAMESPACE     NAME                     TYPE           CLUSTER-IP      EXTERNAL-IP          PORT(S)                         AGE   SELECTOR
kube-system   service/traefik          LoadBalancer   <IP_ADDRESS>   <redacted>           1234:31100/TCP,5555:32586/TCP   43m   app.kubernetes.io/instance=traefik,app.kubernetes.io/name=traefik

After deleting helmchartconfig:

$ k delete -f k3s-helmchartconfig.yaml
helmchartconfig.helm.cattle.io "traefik" deleted

# Again notice age on helm-install-traefik pod:
kube-system   pod/coredns-d76bd69b-vzvp6                    1/1     Running     0          45m   <IP_ADDRESS>    ip-172-31-12-149   <none>           <none>
kube-system   pod/helm-install-traefik-2v25v                0/1     Completed   0          97s   <IP_ADDRESS>    ip-172-31-5-154    <none>           <none>
kube-system   pod/helm-install-traefik-crd-tbqvd            0/1     Completed   0          45m   <IP_ADDRESS>    ip-172-31-12-149   <none>           <none>

# Change accepted
NAMESPACE     NAME                     TYPE           CLUSTER-IP      EXTERNAL-IP          PORT(S)                      AGE   SELECTOR
kube-system   service/traefik          LoadBalancer   <IP_ADDRESS>   <redacted>           80:31100/TCP,443:32586/TCP   45m   app.kubernetes.io/instance=traefik,app.kubernetes.io/name=traefik

Hello, has this found it's way to v1.24? I'm using v1.24.3+k3s1 and the job does not get triggered with either a delete or apply.
Thanks


/devices/{query}/info doesn't work by ip

For API /devices/{query}/info, query a device info by device ip doesn't work.
here is the command:

find the problem. Wrong version. No bother.


NIFI-9968 Add null check before System.setProperty() in test methods

Description of PR
NIFI-9968 Adds a null check before calling System.setProperty() to reset the original user.timezone in TestRecordPath and TestConvertRecord. This resolves build failures on Java 17 where the original user.timezone property is null when retrieved from System.getProperty().
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[X] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?

[X] Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[X] Has your PR been rebased against the latest commit within the target branch (typically main)?

[X] Is your initial contribution a single, squashed commit? Additional commits in response to PR reviewer feedback should be made on this branch and pushed to allow change tracking. Do not squash or use --force when pushing to allow for clean monitoring of changes.

For code changes:

[X] Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
[X] Have you written or updated unit tests to verify your changes?
[ ] Have you verified that the full build is successful on JDK 8?
[ ] Have you verified that the full build is successful on JDK 11?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
[ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
[ ] If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

[ ] Have you ensured that format looks appropriate for the output in which it is rendered?

Note:
Please ensure that once the PR is submitted, you check GitHub Actions CI for build issues and submit an update to your PR as soon as possible.

+1 LGTM, in addition to the checks passign I ran it locally on MacOS using Java 17 and verified there were no test errors. Thanks for the fix! Merging to main


sampleSwaps.R: add an error message in case of missing index files

issue
With the sampleSwaps() function, if no index bai file is provided, it crashes r session without any useful error message.
It will be useful to raise an error that bai index files should be provided.
Thank you

Hi,
Thanks for the issue. I have updated the function. It should now throw an error if it can't find BAI files in the same directory.

Brilliant! Thank you

    if(!file.exists(paste0(x , ".bai"))){       stop("Index file for ", x, " not found!")     }
This looks for file.bam.bai as index, since x is file.bam. It will not find file.bai. Would it be possible for check for either file extension? Thank you

This should work
    if(!file.exists(paste0(sub("\\.bam$", "", x), ".bai")) && !file.exists(paste0(x, ".bai"))){
      stop("Index file for ", x, " not found!")
    }

Hi,
Thanks again. I have updated the function, it should check for both now.

Brilliant! Thank you


[Examples] Char input refactor for setEUI

Q
A

Bug fix?
no

New feature?
no

Doc update?
no

BC breaks?
no

Deprecations?
no

Relative Issues
#

In most recent Arduino IDE I have a warning related to the setEUI function call.
I used Arduino-ide 1.8.9-3 with avr-core 1.6.23-1.
warning: ISO C++ forbids converting a string constant to 'char*' [-Wwrite-strings]
     DW1000Ng::setEUI("AA:BB:CC:DD:EE:FF:00:01");

The problem comes from a convert from string literal (with type const char[]) to char*.
I performed a very simple correction to avoid this tedious warning.
But there are other solution:
Solution 1:
const char *x = "foo bar";
Solution 2:
char *x = (char *)"foo bar";
Solution 3:
char* x = (char*) malloc(strlen("foo bar")+1); // +1 for the terminator strcpy(x,"foo bar");

So with these changes the warning is gone?

So with these changes the warning is gone?

Yes, the warning is gone. My solution is the most simple without changing anything in the library.


client api and tests

What I'd like is to have these files in the client directory:

client-api.c - this contains the functions which could be used by several different clients

This should have reasonable names for all external functions
Put the author name header at the very top of the file
@kstats @jdk514 @sacul29 - please make any necessary fixes for this part and update #73

client-cmd.c - this is a command line-based client that reads arguments from the command line about whether to do a set or get and uses the library to make the request

@kstats @jdk514 @sacul29 - please make any necessary fixes for this part and update #73

client-perf.c - this is a performance tester. It should issue N requests (a command line parameter) and should measure the time taken by each request and store it in a histogram. Remember that each request will require creating a new socket connection.  At the end of the program it should print out the histogram.

@SMonaghan and @Chryel  - please work on this once the client-api.c is merged with final function names.

client-tests.c - this is a test program that can be used to test whether the server is working properly. It might for example might set key1 and then set key2 and then try to get them back to verify the values are correct.  Then it might try to get key3 (which should not exist) and handle that appropriately.  If the keys don't match or if the program segfaults that means the test fail.  It may not be possible to run this as part of an automated Travis test because it will require that a server is actually running.  That's OK with me.

I'll assign this to some of the others who didn't do a GENI project once we know what other tasks remain.

I don't think we need other automated tests for the client API since all of the interesting logic is related to sockets, and there is no easy way to test that with Travis.

to follow the conventions, it looks like client-tests.c and client-perf.c should go in a separate tests subdirectory.

We will make the changes!


CSP-764 Implements GET CalendarEvent by ID

We could have just included calendar navigation property to reach calendar name instead of a completely separate repository.

Done @DevenKShah please review


Which stories still need to be hooked up to APIs?

We want to the city to be able to push new data to the Homelessness Collection, so the existing stories front end should be able to support new data coming in.
We need to do some assessment of the existing stories and APIs:
Which APIs are not hooked up?
Which APIs are not ready?
Which stories will this affect? How do we prep them for the future?

Definition - API connected
Population - API connected
Migration - Hardcoded
Youth - Hardcoded (text)
Women - Hardcoded
Services211 - API connected
I believe Migration and Women can be connected to the API. Setting up the API so that future data can be pushed in is an interesting challenge. To be honest I find some of the ways the endpoints have been set up to be a little nonsensical. It may be worth some meetings to talk about improving how the data is provided.

Thanks @clemf! I created two new issues for Migration/Women cards, and will write up our plan for improving the APIs.


Hap eu access

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)

/test all

/retest

/test all

/hold

Needs adjusting for trial

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: piotrmiskiewicz:x: CICI seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: piotrmiskiewicz:x: CICI seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


⚠ Bofrost.at has degraded performance

In d38a58d, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1913 ms

Resolved: Bofrost.at performance has improved in 34a63ee after 26 minutes.


if True: print("true") fails on C++

if True: print("true")

becomes:
({
    std::cout << std::string{"true"};
    std::cout << std::endl;
    ;
  })

error:
cases/coverage.cpp:84:5: error: call to deleted constructor of 'std::__1::basic_ostream<char>'
    std::cout << std::endl;
    ^~~~~~~~~~~~~~~~~~~~~~
/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/c++/v1/ostream:182:5: note: 'basic_ostream' has been explicitly marked deleted here
    basic_ostream           (const basic_ostream& __rhs) = delete;
    ^
cases/coverage.cpp:86:5: error: expected ';' after expression
  })

Fixed by
https://github.com/adsharma/py2many/pull/221/commits/ee297e119bc80f0fde4fea1dc7497bc0067f88e7


Issue 143/routes dropdown menu

Description
This PR creates a dropdown menu for the route links (Home, Forms, Inbox) in the Navbar if on a small screen.
It also adds a backdrop so the menu is easily focused and seen.
Added this same backdrop to the other existing Navbar menu (Profile, Settings, Logout.)
Updates
https://github.com/codeforpdx/PASS/assets/71395931/c0f646fe-172f-4ada-a6d5-989687d41778
Related Issue
Closes Issue #143
Future Thoughts

Can refactor the 2 menu components (NavMenu and NavMenuMobile) into 1. There's only one item difference between the 2 codebases.
Can refactor Navbar.jsx to maybe list everything rendered for mobile navbar then everything rendered for desktop navbar. Currently it lists the elements in the order they display onscreen, so it alternates.
Can most likely refactor the states and the functions of opening and closing the menus. I'm sure they can be condensed to just 1 or 2 and reused.

It looks nice. Although depending on how many tabs we decide to go with. If we stick with only a couple, this may not be necessary. Having two dropdown menus could end up being a bit unappealing.
We can take a look at those refactoring suggestions.
The UX designs I've seen don't have a large number of tabs. So far I see just My Clients and Documents. Though, of crouse, that can change.
Simplifying as much as possible is best, imo. We want to take as much effort off of the user as possible.
Also, I'm not sure if this is just me, but the screen recordings always freeze after one second. I have to constantly restart it. It's like this no matter who's posting the recording.

I think the dropdown menus look great. The only issue I really came across was the one that Ka Hung just recently mentioned.
My main concern is the same as Andy's. I believe that having two dropdown menus is a bit unappealing; hopefully we'll have a small enough amount of tabs that this isn't something which will be required. I do like that you made it so the navigation dropdown explicitly states "Navigate to..." but I do think that if we could avoid making this a dropdown at all, that would be ideal.


PKCS #12 keys are not supported in gRPC

gRPC doesn't support PKCS #12 service account keys. This means that creating storage::GrpcClient from a .p12 file doesn't work.
We should probably fix this by implementing the support in gRPC (boring SSL seems to have support for it, so it should be pretty easy).
Alternatively, we could try to transform the .p12 keys in the storage library, but I'm afraid there is no way to do it (the .p12 doesn't contain the service account email).

Closing because we're not going to support PKCS #12


apiserver-kicker didn't detect adding IP.3 in [alt_names]

snap restart microk8s doesn't help too.
I am using Scaleway, so my external ip is not on local interface, but accessible outside. Anyway, kubectl says me:
kubectl --kubeconfig=kube-config  get pods
Unable to connect to the server: x509: certificate is valid for <IP_ADDRESS>, <IP_ADDRESS>, <IP_ADDRESS>, <IP_ADDRESS>, <IP_ADDRESS>, not <MY EXTERNAL IP>

cat /var/snap/microk8s/current/certs/csr.conf.template:
[ req ]
default_bits = 2048
prompt = no
default_md = sha256
req_extensions = req_ext
distinguished_name = dn

[ dn ]
C = GB
ST = Canonical
L = Canonical
O = Canonical
OU = Canonical
CN = <IP_ADDRESS>

[ req_ext ]
subjectAltName = @alt_names

[ alt_names ]
DNS.1 = kubernetes
DNS.2 = kubernetes.default
DNS.3 = kubernetes.default.svc
DNS.4 = kubernetes.default.svc.cluster
DNS.5 = kubernetes.default.svc.cluster.local
IP.1 = <IP_ADDRESS>
IP.2 = <IP_ADDRESS>
IP.3 = <MY EXTERNAL IP> <=== ADD THIS LINE
#MOREIPS

[ v3_ext ]
authorityKeyIdentifier=keyid,issuer:always
basicConstraints=CA:FALSE
keyUsage=keyEncipherment,dataEncipherment,digitalSignature
extendedKeyUsage=serverAuth,clientAuth
subjectAltName=@alt_names

microk8s inspect:
Inspecting Certificates
Inspecting services
  Service snap.microk8s.daemon-cluster-agent is running
  Service snap.microk8s.daemon-containerd is running
  Service snap.microk8s.daemon-apiserver is running
  Service snap.microk8s.daemon-apiserver-kicker is running
  Service snap.microk8s.daemon-proxy is running
  Service snap.microk8s.daemon-kubelet is running
  Service snap.microk8s.daemon-scheduler is running
  Service snap.microk8s.daemon-controller-manager is running
  Copy service arguments to the final report tarball
Inspecting AppArmor configuration
Gathering system information
  Copy processes list to the final report tarball
  Copy snap list to the final report tarball
  Copy VM name (or none) to the final report tarball
  Copy disk usage information to the final report tarball
  Copy memory usage information to the final report tarball
  Copy server uptime to the final report tarball
  Copy current linux distribution to the final report tarball
  Copy openSSL information to the final report tarball
  Copy network configuration to the final report tarball
Inspecting kubernetes cluster
  Inspect kubernetes cluster

WARNING:  Docker is installed.
File "/etc/docker/daemon.json" does not exist.
You should create it and add the following lines:
{
    "insecure-registries" : ["localhost:32000"]
}
and then restart docker with: sudo systemctl restart docker
Building the report tarball
  Report tarball is at /var/snap/microk8s/1769/inspection-report-20201102_143139.tar.gz

inspection-report-20201102_143139.tar.gz

The apiservice kicker will try to get all the interfaces available in the host.
Chances are IP.3 is being overridden.  Try instead using IP.99.  it just need to have a unique key.

IP.0 is probably a better option for adding a NAT'ed public address.
IMHO the render_csr_conf() function in actions/common/utils.sh is over-optimistic by setting local -i i=3, and would be better by either

counting the number of IP.n lines set in the templatelocal -i i=$(grep -co '^IP\.' ${SNAP_DATA}/certs/csr.conf.template)
...
     for IP_ADDR in $(echo "$IP_ADDRESSES"); do
         ips+="${sep}IP.$((++i)) = ${IP_ADDR}"
         sep='\n'
     done

or simply start at a higher numberlocal -i i=10

or something.


Add jobs for grouping similar photos in PhotoGroups

Outline:

The first photo-hash job adds a dhash field to each photo. The dhash is a 128 bit
downsampled representation of the photo that works well for visual similarity comparisions.
The second photo-dedup job groups photos that have similar dhash's into PhotoGroups.

toward: #2787

Current coverage is 87.80% (diff: 7.79%)

Merging #2789 into master will decrease coverage by 0.31%

@@             master      #2789   diff @@
==========================================
  Files           250        254     +4
  Lines         18738      18815    +77
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
+ Hits          16512      16520     +8
- Misses         1949       2018    +69
  Partials        277        277

Diff Coverage
File Path

0%
new samples/go/photo-dedup/model/photogroup.go

0%
new samples/go/photo-dedup/model/photo.go

0%
new samples/go/photo-dedup/model/id.go

•••••••••• 100%
new samples/go/photo-dedup/model/commitmeta.go

Powered by Codecov. Last update 26391d9...99b3280

Super excited to see this by the way!


fix(popover): unexpected props on a DOM element

Closes #2474
Closes #2528
Closes #2593

📝 Description
Currently if you create a Custom Trigger in Dropdown with elements which don't have isDisabled prop, e.g. div, <User/>, adding isDisabled would make React fail to recognize it on a DOM element. Hence, adding the isDisabled logic to cover this case. Also remove isDisabled prop for non NextUI button elements.
⛳ Current behavior (updates)
Currently if you set isDisabled to dropdown, it won't make it disabled.

🚀 New behavior
With this fix, the dropdown is disabled.

💣 Is this a breaking change (Yes/No):

No
📝 Additional Information

Summary by CodeRabbit

New Features

Introduced a new property isDropdownDisabled for enhanced control over the disabled state of Popover triggers.

Enhancements

Improved handling of custom triggers and DOM elements within Popover components, including disabled state management.
Added a utility function to identify NextUI components, enhancing component recognition capabilities.

@wingkwong could you please add some tests to avoid this happening in the future?


Use repeat instead of break label for utf8ToString

This update doesn't change functionality, but improves the (LLVM) loop optimizer. Using labeled statement with an infinite loop created a complex nested loop, which led inefficient codegen. More importantly it could cause mis-compilation depending on a LTO flag. This patch uses a repeat command with a boolean check to make the loop simpler and more efficient.

@thomasvl @gjcairo I'm not sure if this is a right process to request a PR here. But found this code was problematic in our code base in a certain combination of opts, and the suggested change produced much cleaner code.  Let me know how to test this code.

If there compiler does better with the change, I think there are a few other loops in the library that maybe should be tweaked.

Thanks all for looking at this issue. It seems my first attempt was entirely off, but after further investigation, I've come up with another workaround. I've reported a bug in LLVM, which you can find at https://github.com/llvm/llvm-project/issues/93110. I don't intend to upstream this workaround in the source as it seems too disruptive, but perhaps use this workaround in our downstream. Anyhow, I'm sharing this with a comment for reference.

Thanks so much for your diligent work root-causing this, and for providing a workaround. As we only see a severe issue in thin-lto mode I'm ok with us calling the current code good, and waiting for Swift to fix the apparent miscompile issue. I've flagged this for the Swift team.


CLI parameter help menu

Description:
When an error happens CLI should print the expected input format
eg:
error: all operand arguments are not matched
usage: find [-H | -L | -P] [-EXdsx] [-f path] path ... [expression]
       find [-H | -L | -P] [-EXdsx] -f path [path ...] [expression]

Describe your problem(s)
Describe your solution(s)
Related Issues (optional):

Suggested Labels (optional):

Suggested Assignees (optional):

A suggestion for usage syntax
Here bal run [--experimental] [--offline] [<executable-jar | ballerina-file | package-path>] is omitted because it is lengthy and wants to highlight the expected arguments. Only [-- program-args...] are displayed in the usage message as shown below.
usage: [--long-option1] [--long-option2]... [--long-option3=int] [--long-option4=string|error] [--long-option5[=float|int]] [--long-option6=float]... operand1 operand2 operand3...
    operand1: string
    operand2: float
    operand3: int

Or instead of “operand3…”, “[operand3]” can be there.
Here I have omitted the “--” in the usage line. I think if I am running a file.bal it should be before the “[--long-option1]” and if I am running a file.jar it should be before the “operand1”. If so, please suggest a suitable way to depict that in the usage line.

Example for the above suggestion
Say we have the following main function.
public type GrepOptions record {|
    int 'after\-context = 0;
    int 'before\-context = 0;
    boolean 'ignore\-case;
    boolean 'line\-number;
    boolean recursive;
    string? file;
|};

public function main(string pattern, string fileName,
    *GrepOptions grepOptions) returns error? {

So the usage line is like
usage: [--after-context=int] [--before-context=int] [--ignore-case] [--line-number] [--recursive] [--file=string] pattern fileName
    pattern: string
    fileName: string


Improves support to Windows UNC files in a "yet-to-be-saved" state

Fixes #49851
Improves support to Windows UNC files in a "yet-to-be-saved" state, which addresses the problem with creating .gitignore in a network folder from "Add to .gitignore" command.

@jrieken I completely understand your concern, and that was not my initial attempt as well. I've been working on the codebase for just a few days, so I might obviously be missing something, but let me explain the reasoning behind the fix and then we could try to find a better path. Sorry for the long reply.
Assuming you have the following scenario:

Empty folder located at \\some-server\some-share\test
User executed git init inside test
This folder only has one file, a.txt
The folder does not have a .gitignore file

In the current flow, when the user opens the folder \\some-server\some-share\test in VSCode, goes to the SCM panel, right clicks a.txt and selects Add to .gitignore, VSCode will run the logic in https://github.com/Microsoft/vscode/blob/master/extensions/git/src/repository.ts#L876, that will check whether .gitignore already exists. It doesn't, so the document const will contain a reference to a URI with the scheme untitled. This allows the editor to open with a file that is still in-memory (it does not have the scheme set to file yet). As a user of VSCode, I really like this design decision, as it lets me "confirm" my action by saving the file after I evaluate the changes, or just close it without saving, going back to the state I was in.
The problem here is that the code does not support constructing the fsPath from a URI that has a scheme different than file.

First, I tried to force the scheme to be file instead of untitled, which fails as the file is not yet persisted. I gave up that path as it felt like I would need to change the semantics behind the scheme file to make it work in before it actually exists in the disk.
Then I thought of creating the .gitgnore file immediately, which would allow me to have a URI with the scheme file and the rest would just work, but this approach breaks the existing design and removes the ability for the user to go back to the previous state by just closing the file without saving it.
Then I got to the code in this PR. Even though it is an internal change, based on what I saw in the code, the scheme only transitions from untitled to file, which would not be a problem. Also, from what I could gather, all the use cases where scheme and authority are involved besides UNC, are related to URLs (http or https), so I didn't see any risks. An added "bonus" is that if any similar use case of in-memory files over UNC paths are required now or in the future, this improvement would enable them transparently.

Let me know if any of the other approaches sound better to you, or if you know about any other possible paths I could explore, I will definitely give them a shot.

Let me know if any of the other approaches sound better to you, or if you know about any other possible paths I could explore,

Yeah, don't get me wrong. The change does look good but I am extremely conservative when it comes to uri-changes. It's huge source of bikeshedding and there will be many people arguing withs loads of passion why that change isn't good.
So, I wonder if we can tackle this at the place in which an untitled file is being saved. Somewhere (@bpasero should know where) the untitled-uri must be turned into a file-uri and instead of calling fsPath it should construct an fsPath-equivalent from the components of the uri itself.

could be this file of code: https://github.com/Microsoft/vscode/blob/b7e6e04666ca8dde560b69081c43365dce77d12a/src/vs/workbench/services/textfile/common/textFileService.ts#L446

Reminds me of this series of debt-issues we went through: https://github.com/Microsoft/vscode/issues?utf8=✓&q=is%3Aissue+fsPath+"Don't+call+URI%23fsPath"+

Just double-checking before implementing your suggestion, the use case I described above is also replicated in https://github.com/Microsoft/vscode/blob/master/extensions/typescript-language-features/src/utils/tsconfig.ts#L63-L64, and as the screenshot below shows, this patch also fixes that:

@jrieken Do you still prefer to address this use case on a case-by-case approach instead of a generic solution? If so, I no worries, I'll submit a new patch.
/cc @bpasero

Yeah, I believe a fix in the service for untitled files will also cover the TypeScript part.

Understood! Let me work on that and I'll update the PR.

@bpasero @jrieken I isolated the changes around TextFileService, as suggested. Let me know if you have any additional feedback.

Looks good to me but I'll leave it up to @bpasero

@bpasero completely agreed with the recommendation and thanks for pointing out another place that needed the fix. I've updated the PR with the changes you suggested.

@LeonardoBraga thanks 👍


Refresh the datatable

Hi, how can I refresh the datatable after I have updated or added new items?
Now I have to refresh the  browser to do it.

You can reload the data by using any state management, then the widget will update when data change.


 Run the simple buyapple algorithm on CSV data (The data is not really of AAPL)

What happened instead?
Traceback (most recent call last):
File "", line 1, in
runfile('D:/Data/CSE/zip_a.py', wdir='D:/Data/CSE')
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\spyder\utils\site\sitecustomize.py", line 880, in runfile
execfile(filename, namespace)
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\spyder\utils\site\sitecustomize.py", line 87, in execfile
exec(compile(scripttext, filename, 'exec'), glob, loc)
File "D:/Data/CSE/zip_a.py", line 29, in
algo_obj = TradingAlgorithm(initialize=initialize, handle_data=handle_data, capital_base = 100000.0)
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\zipline\algorithm.py", line 280, in init
self.trading_environment = TradingEnvironment()
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\zipline\finance\trading.py", line 101, in init
self.bm_symbol,
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\zipline\data\loader.py", line 164, in load_market_data
trading_day,
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\zipline\data\loader.py", line 247, in ensure_benchmark_data
last_date,
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\zipline\data\benchmarks.py", line 59, in get_benchmark_returns
squeeze=True,  # squeeze tells pandas to make this a Series
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\pandas\io\parsers.py", line 562, in parser_f
return _read(filepath_or_buffer, kwds)
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\pandas\io\parsers.py", line 301, in _read
compression=kwds.get('compression', None))
File "C:\Anaconda2\envs\cse_32_2_7\lib\site-packages\pandas\io\common.py", line 308, in get_filepath_or_buffer
req = _urlopen(str(filepath_or_buffer))
File "C:\Anaconda2\envs\cse_32_2_7\lib\urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "C:\Anaconda2\envs\cse_32_2_7\lib\urllib2.py", line 435, in open
response = meth(req, response)
File "C:\Anaconda2\envs\cse_32_2_7\lib\urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Anaconda2\envs\cse_32_2_7\lib\urllib2.py", line 473, in error
return self._call_chain(*args)
File "C:\Anaconda2\envs\cse_32_2_7\lib\urllib2.py", line 407, in _call_chain
result = func(*args)
File "C:\Anaconda2\envs\cse_32_2_7\lib\urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

HTTPError: Not Found
Here is how you can reproduce this issue on your machine: The following is the code I use. The CSV files are in the working directory. The file name (before .csv) is the symbol name.
from zipline.api import order, record, symbol
import pandas as pd
import glob
import pytz
from collections import OrderedDict
allFiles = glob.glob("*.csv")
datas = OrderedDict()
parser = lambda date: pd.datetime.strptime(date, '%d/%m/%Y')
for file_ in allFiles:
str_ = file_.split(".")
df_ = pd.read_csv(file_, header=None, names=["Date","Open","High","Low","Close","Volume"],parse_dates=['Date'],date_parser=parser,index_col='Date')
df_ = df_[~df_.index.duplicated(keep='first')]
datas[str_[0]] = df_
pan = pd.Panel(datas)
pan.minor_axis = ['Open', 'High', 'Low', 'Close', 'Volume']
pan.major_axis = pan.major_axis.tz_localize(pytz.utc)
def initialize(context):
pass
def handle_data(context, data):
order(symbol('AAPL'), 10)
record(AAPL=data.current(symbol('AAPL'), 'price'))
algo_obj = TradingAlgorithm(initialize=initialize, handle_data=handle_data, capital_base = 100000.0)
#run algo
perf_manual = algo_obj.run(pan)
Reproduction Steps

Run the above code with csv OHLCV data for AAPL.

What steps have you taken to resolve this already?
Checked the panel to see if AAPL symbol is there, and it is.
<class 'pandas.core.panel.Panel'>
Dimensions: 4 (items) x 5039 (major_axis) x 5 (minor_axis)
Items axis: AAPL to TWX
Major_axis axis: 1993-12-19 00:00:00+00:00 to 2017-06-07 00:00:00+00:00
Minor_axis axis: Open to Volume
...
Sincerely,
MAJ

Hey @reMAJ thanks for posting. There's a few things going on here so I'll try and address each issue; I'll also need some more information from you.

Conda install failed because we don't support 32-bit Windows packages. Zipline might work on 32-bit but it's not guaranteed.
Can you run the buyapple example on it's own?
When you ran zipline run what did that command look like exactly?

Thanks!
Freddie

@reMAJ ah. I see you have zipline 1.1.0 installed. The latest version does not work currently because of changes Yahoo made to their API. You'll want to use the latest zipline master, which now uses Google Finance to get equity data for benchmarks

@FreddieV4  Thanks a lot. I am very sorry, but I need some info to run with Google.
(1)Conda install failed because we don't support 32-bit Windows packages. Zipline might work on 32-bit but it's not guaranteed. : conda install failed with 64bit Anaconda too. There were conflicts with bottleneck. (anyways this is not an issue now in the 32 bit environment)
(2)Can you run the buyapple example on it's own? How do I use "the latest zipline master"
(3)When you ran zipline run what did that command look like exactly? I don't understand the question. I had the above pasted code in the .py file and I ran it in spyder, which means at the IPython console of spyder:  runfile('D:/Data/CSE/zip_a.py', wdir='D:/Data/CSE')

To run the latest zipline master, you'll need to have a local copy of zipline, first by forking the repo, and then running git clone git@github.com:reMAJ/zipline.git.  You can then run pip install -e zipline/ assuming you're in a directory that holds the zipline directory.
In regards to the zipline run comment, I must have skimmed over the fact that you used algo.run() instead. I suggest not using algo.run() and using the zipline CLI to run your algorithm. You can find more info in the Beginner Tutorial

@FreddieV4  Thanks again.
I downloaded the zipline master from git and did pip install -e . staying in the zipline-master folder. It uninstalled my current zipline and then installed the master. However, conda list won't show the new zipline. But pip freeze show it as: zipline==0+unknown
Then I put the following code of the buyapple example in zip_a.py file.
from zipline.api import order, record, symbol
def initialize(context):
    pass
def handle_data(context, data):
    order(symbol('AAPL'), 10)
    record(AAPL=data.current(symbol('AAPL'), 'price'))

Then ran it in cmd. Gets the following error.
D:\Data>zipline run -f ./zip_a.py --start 2000-1-1 --end 2014-1-1 -o buyapple_out.pickle
Traceback (most recent call last):
  File "C:\Anaconda2\Scripts\zipline-script.py", line 6, in <module>
    from pkg_resources import load_entry_point
  File "C:\Anaconda2\lib\site-packages\setuptools-23.0.0-py2.7.egg\pkg_resources\__init__.py", line 2927, in <module>
  File "C:\Anaconda2\lib\site-packages\setuptools-23.0.0-py2.7.egg\pkg_resources\__init__.py", line 2913, in _call_aside
  File "C:\Anaconda2\lib\site-packages\setuptools-23.0.0-py2.7.egg\pkg_resources\__init__.py", line 2940, in _initialize_master_working_set
  File "C:\Anaconda2\lib\site-packages\setuptools-23.0.0-py2.7.egg\pkg_resources\__init__.py", line 637, in _build_master
  File "C:\Anaconda2\lib\site-packages\setuptools-23.0.0-py2.7.egg\pkg_resources\__init__.py", line 650, in _build_from_requirements
  File "C:\Anaconda2\lib\site-packages\setuptools-23.0.0-py2.7.egg\pkg_resources\__init__.py", line 829, in resolve
pkg_resources.DistributionNotFound: The 'pandas<0.18,>=0.16.1' distribution was not found and is required by zipline

Tried to down grade panads and conda fails
conda install pandas=0.16.0
Fetching package metadata ...........
Solving package specifications: .

UnsatisfiableError: The following specifications were found to be in conflict:
  - matplotlib
  - navigator-updater
  - pandas 0.16.0*
Use "conda info <package>" to see the dependencies for each package.

pip succeeded
pip install -Iv pandas==0.16.0
Then I ran the algorithm in the cmd, but still get an error. I read a little bit online and it seems like I don't have an ingestion of Google. Please, how do I solve it?
D:\Data>zipline run -f ./zip_a.py --start 2000-1-1 --end 2014-1-1 -o buyapple_out.pickle
Traceback (most recent call last):
  File "C:\Anaconda2\envs\cse_32_2_7\Scripts\zipline-script.py", line 11, in <module>
    load_entry_point('zipline', 'console_scripts', 'zipline')()
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 697, in main
    rv = self.invoke(ctx)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\__main__.py", line 97, in _
    return f(*args, **kwargs)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\__main__.py", line 240, in run
    environ=os.environ,
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\utils\run_algo.py", line 119, in _run
    bundle_timestamp,
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\data\bundles\core.py", line 521, in load
    timestr = most_recent_data(name, timestamp, environ=environ)
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\data\bundles\core.py", line 497, in most_recent_data
    timestamp=timestamp,
ValueError: no data for bundle u'quantopian-quandl' on or before 2017-06-08 19:48:43.522000+00:00
maybe you need to run: $ zipline ingest -b quantopian-quandl

@reMAJ Ok so just to confirm what you're doing here.
You have a virtualenv, let's say it's called zipline, and you are in a directory which has the zipline directory in it, like so:

And then you ran pip install -e zipline. When you run pip freeze, it should say something like:

Which says that you have done an editable install of zipline, pinned to a specific commit hash (also just remembering that you don't have to have the -e flag for your pip install, but it should work either way here).
If you did all of that, then the next step is to run zipline ingest -b quantopian-quandl in your command prompt, and then run the example code using zipline run

@FreddieV4 Thanks. I have an environment called cse_32_2_7 and I installed the zipline master as you instructed. Then I ran the command zipline ingest -b quantopian-quandl, and gots this error.
(cse_32_2_7) C:\WINDOWS\system32>zipline ingest -b quantopian-quandl
Traceback (most recent call last):
  File "C:\Anaconda2\envs\cse_32_2_7\Scripts\zipline-script.py", line 11, in <module>
    load_entry_point('zipline', 'console_scripts', 'zipline')()
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 697, in main
    rv = self.invoke(ctx)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\click\core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\__main__.py", line 312, in ingest
    show_progress,
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\data\bundles\core.py", line 364, in ingest
    calendar = get_calendar(bundle.calendar_name)
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\utils\calendars\calendar_utils.py", line 88, in get_calendar
    calendar = self._calendars[canonical_name] = factory()
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\utils\calendars\trading_calendar.py", line 87, in __init__
    _special_closes = self._calculate_special_closes(start, end)
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\utils\calendars\trading_calendar.py", line 841, in _calculate_special_closes
    end,
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\utils\calendars\trading_calendar.py", line 820, in _special_dates
    for time_, calendar in calendars
  File "c:\users\majesticresearch1\downloads\zipline-master\zipline\utils\calendars\trading_calendar.py", line 892, in holidays_at_time
    calendar.holidays(start, end),
  File "c:\anaconda2\envs\cse_32_2_7\lib\site-packages\pandas\tseries\holiday.py", line 332, in holidays
    if self._cache is None or start < self._cache[0] or end > self._cache[1]:
  File "pandas\tslib.pyx", line 826, in pandas.tslib._Timestamp.__richcmp__ (pandas\tslib.c:15597)
  File "pandas\tslib.pyx", line 858, in pandas.tslib._Timestamp._assert_tzawareness_compat (pandas\tslib.c:15951)
TypeError: Cannot compare tz-naive and tz-aware timestamps

And you got that error after downgrading pandas? (I don't think we want to downgrade pandas here though)

@FreddieV4  I down graded it yesterday. But conda list shows me 3 pandas. I don't know which one zipline choose. conda and pip shows difference information
(cse_32_2_7) C:\WINDOWS\system32>conda list
# packages in environment at C:\Anaconda2\envs\cse_32_2_7:
pandas                    0.16.0                    <pip>
pandas                    0.18.1                    <pip>
pandas                    0.20.1              np112py27_0

pip only shows 1 pandas version. Even though I downgraded using pip.
(cse_32_2_7) C:\WINDOWS\system32>pip freeze

pandas==0.18.1

@FreddieV4  I rand the buyapple example on an Ubuntu 16.04.1 LTS machine with
pandas                    0.18.1              np111py27_0
zipline                   1.1.0               np111py27_0    Quantopian
The code is from the example:
from zipline.api import order, record, symbol
def initialize(context):
    pass
def handle_data(context, data):
    order(symbol('AAPL'), 10)
    record(AAPL=data.current(symbol('AAPL'), 'close'))

Then I ran it as instructed.
$zipline ingest -b quantopian-quandl
$zipline bundles
quandl <no ingestions>
quantopian-quandl 2017-06-10 09:40:26.415661
$zipline run -f ./zip_aapl.py --start 2017-1-1 --end 2017-6-9 -o buyapple_out.pickle

Got the error raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 404: Not Found

Can you try installing the latest version of zipline?

Hi @reMAJ I'm going to close this due to inactivity but feel free to re-open if you have other issues 🙂


exceptions

sorry, I'm not very experienced, but I can't understand what's wrong.

These are part of the normal operation of the client.
These exceptions are thrown by either the underlying framework, or monotorrent, and then are correctly handled.

thanks for the answer, i have a question to ask you,  can show the download percentage of a torrent file that is being downloaded ?(winform)

You can access TorrentManager.Progress for the % completion. If you look at TorrentManager.Torrent.Files you can get statistics for each individual file


Add support for reactive MongoDB configuration (2.0)

Provide configuration for MongoDB reactive when Project Reactor and mongodb-driver-reactivestreams are on the class-path.

Closing this issue in favor of using Java CfEnv for consuming MongoDB services.


The extension host (LocalProcess) terminated unexpectedly.

Environment data

VS Code version: 1.78.2
Jupyter Extension version (available under the Extensions sidebar): v2023.3.1000892223 (and above)
Python Extension version (available under the Extensions sidebar): v2023.8.0
OS (Windows | Mac | Linux distro) and version: macOS High Sierra 10.13.6
Python and/or Anaconda version: Python 3.8.2
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): venv

VS Code

Version: 1.78.2
Commit: b3e4e68a0bc097f0ae7907b217c1119af9e03435
Date: 2023-05-10T14:44:45.204Z (3 wks ago)
Electron: 22.5.2
Chromium: 108.0.5359.215
Node.js: 16.17.1
V8: <IP_ADDRESS>-electron.0
OS: Darwin x64 17.7.0
Sandboxed: Yes

VS Code - Insiders

Version: 1.79.0-insider (Universal)
Commit: 05ae089c791aa5c8ec05abd5687c9a31517579bc
Date: 2023-06-02T09:42:42.311Z (23 hrs ago)
Electron: 22.5.5
Chromium: 108.0.5359.215
Node.js: 16.17.1
V8: <IP_ADDRESS>-electron.0
OS: Darwin x64 17.7.0

Expected behaviour
Kernel should load properly and allow to Select Another Kernel... (if necessary).
Actual behaviour
Kernel crashes with the following error message:
Extension host terminated unexpectedly 3 times within the last 5 minutes.
The option Select Another Kernel... is empty. No other kernels can be selected.
Afterwards, although Jupyter is installed, VS Code outputs the following error message:
Error: Cannot open resource with notebook editor type 'jupyter-notebook'...
Steps to reproduce:
It turns out that one of the node modules of ms-toolsai.jupyter, i.e. zeromq is the culprit.
Newer versions of ms-toolsai.jupyter load node.napi.glibc.node instead of node.napi.node. Note that node.napi.glibc.node was built for macOS Catalina 10.15. Also note that these newer versions come shipped with two folders, namely zeromq and zeromqold. Somehow, zeromqold is not loaded in case that zeromq fails. Else,
What's the purpose of zeromqold?
Temporary solution
To solve this for older versions of macOS, either:

Manually replace node.napi.glibc.node with node.napi.node.
or
Rename the zeromq to zeromqnew, and zeromqold to zeromq.

Preferably save a backup as node.napi.glibc.node.bak just in case.
Logs

Command Palette > Developer: Toggle Developer Tools

[Extension Host] Starting WebSocket: RAW/api/kernels/b7ad93b0-b61d-418a-93a8-adb9d7ae5a64 (at console.<anonymous> (/Applications/Visual Studio Code - Insiders.app/Contents/Resources/app/out/vs/workbench/api/node/extensionHostProcess.js:99:161026))

Starting WebSocket: RAW/api/kernels/b7ad93b0-b61d-418a-93a8-adb9d7ae5a64
dyld: lazy symbol binding failed: Symbol not found: ____chkstk_darwin
    Referenced from: /Users/user-1/.vscode-insiders/extensions/ms-toolsai.jupyter-2023.4.1011241018-darwin-x64/out/node_modules/zeromq/prebuilds/darwin-x64/node.napi.glibc.node (which was built for Mac OS X 10.15)
    Expected in: /usr/lib/libSystem.B.dylib
dyld: Symbol not found: ____chkstk_darwin
    Referenced from: /Users/user-1/.vscode-insiders/extensions/ms-toolsai.jupyter-2023.4.1011241018-darwin-x64/out/node_modules/zeromq/prebuilds/darwin-x64/node.napi.glibc.node (which was built for Mac OS X 10.15)
    Expected in: /usr/lib/libSystem.B.dylib

The extension host (LocalProcess) terminated unexpectedly. Code: 6, Signal: unknown

Remarks
Please fix this as soon as possible, at least for the Jupyter Pre-Release Version. Thanks!

Thank you for filling this issue and sorry you are running into this.

Catalina 10.15.

Ok so that could be the problem. I will look into this asap.
Thank you very much for the information and the logs

Also note that these newer versions come shipped with two folders, namely zeromq and zeromqold. Somehow, zeromqold is not loaded in case that zeromq fails. Else,

The old folder is a backup of the first fails to load. Looks like we fail to list from the first folder, however this crashes the extension host hence never goes to the backup.
I will look into this asap.
@deepak1556 /cc

Just wanted to get a few things first,
@angel-blake
What version of MacOS do you have, Do you have High Sierra?

Do you have High Sierra?

Yes. As per the context of the issue opened, the latest macOS High Sierra 10.13.6 Final Version (Build 17G65).

@deepak1556 thank you very much, will try that.

@angel-blake

Please could you download the following file, extract it
Go into VS Code Insiders and from the command palette install this using the command Install from VSIX
Let me know how this goes
Please remember to use VS Code Insiders

ms-toolsai-jupyter-insiders.vsix (2).zip

Thank you for your response @DonJayamanne.
I followed all the steps (one-to-one), and sadly it still results in the same error:

[Extension Host] Starting WebSocket: RAW/api/kernels/... (at console. (/Applications/Visual Studio Code - Insiders.app/Contents/Resources/app/out/vs/workbench/api/node/extensionHostProcess.js:99:161026))
Starting WebSocket: RAW/api/kernels/...
dyld: lazy symbol binding failed: Symbol not found: ____chkstk_darwin
Referenced from: /Users/user-1/.vscode-insiders/extensions/ms-toolsai.jupyter-2023.6.100/out/node_modules/zeromq/prebuilds/darwin-x64/node.napi.glibc.node (which was built for Mac OS X 10.15)
Expected in: /usr/lib/libSystem.B.dylib
dyld: Symbol not found: ____chkstk_darwin
Referenced from: /Users/user-1/.vscode-insiders/extensions/ms-toolsai.jupyter-2023.6.100/out/node_modules/zeromq/prebuilds/darwin-x64/node.napi.glibc.node (which was built for Mac OS X 10.15)
Expected in: /usr/lib/libSystem.B.dylib
The extension host (LocalProcess) terminated unexpectedly. Code: 6, Signal: unknown

Note that Jupyter v2023.6.100 was successfully via Extensions: Install from VSIX...

Suggestion:
Instead of having two folders lying around, i.e. zeromq and zeromqold, why don't you add both of the files node.napi.glibc.node and node.napi.node to darwin-x64 and darwin-arm64? Then, simply check for the corresponding macOS release version with a conditional clause. You could use the OS module like this:
var os = require('os');
os.platform(); // 'darwin'
os.release(); //  '10.8.0'

and then map the release version to a specific version of macOS. Darwin to macOS mappings can be found here.
Essentially, any os.release() >= 19.0.0 should load node.napi.glibc.node, else load node.napi.node.

@DonJayamanne the logs shows the module is still built for 10.15, can you check if the versions are correct
dyld: Symbol not found: ____chkstk_darwin
Referenced from: /Users/user-1/.vscode-insiders/extensions/ms-toolsai.jupyter-2023.6.100/out/node_modules/zeromq/prebuilds/darwin-x64/node.napi.glibc.node (which was built for Mac OS X 10.15)

the logs shows the module is still built for 10.15

Precisely @deepak1556, node.napi.glibc.node was built for macOS 10.15. Hence, my suggestion.

@angel-blake thanks for the suggestions, unfortunately we're using existing packages like node-gyp that loads native packagbes.
@deepak1556 I missed another place where 10.15 is set, the build.ts file has a hardcoded setting of 10.15 that seems to only apply to arm, but they change it for intel builds as well. will re-create another build.

@DonJayamanne the last VSIX build also results in the same error. The extension still loads node.napi.glibc.node.
AFAIK, node-gyp is a cross-platform command-line tool written in Node.js for compiling native addon modules for Node.js. I really don't understand why you don't add both of the files node.napi.glibc.node and node.napi.node to the zeromq prebuilds and add the conditional clause to check for the macOS version before compiling the code. This way, the issue could've been solved already. Please correct me if I'm wrong.

zeromq/.../node.napi.glibc.node

This issue built for Marcos, built by us using azure piplelines

zeromq old/../node.napi.node

Those is the old binary build and published in npm, we are trying to move away from this as this binary
We cannot add both into the same folder and make it work the way you have suggested.
Loading goes don't work the way your suggested, we do not load them the existing node packages look for files and load them.
The problem is not that we are still loading the wrong file, the root cause is the fact that the file does not load and we need to fix that.
That's what I'm trying to do, trying to recompile the file to ensure it loads on your machine.
Ie we need to compiler the file for 10.9, instead of trying to load different files.
The zeromqold is loaded if the first fails, unfortunately it brings down the whole process hence the backup fails.
@deepak1556  let's chat tomorrow about this and try to figure out what's wrong with the compilation

We cannot add both into the same folder and make it work the way you have suggested. Loading goes don't work the way your suggested, we do not load them the existing node packages look for files and load them.
The problem is not that we are still loading the wrong file, the root cause is the fact that the file does not load and we need to fix that.
That's what I'm trying to do, trying to recompile the file to ensure it loads on your machine. Ie we need to compiler the file for 10.9, instead of trying to load different files. The zeromqold is loaded if the first fails, unfortunately it brings down the whole process hence the backup fails.

I see @DonJayamanne. Thanks for the explanation!

This should now be fixed in the latest versions of VS Code and Jupyter extension


[ Application ] Fix VGG using CCAPI

This patch includes the fixes of VGG Application.

Remove the training data generation with batch size.
: Recently we update the data generation callback to fill one data
set a time
Remove include the nntrainer interanls : neuralnet.h
: Update to use CCAPI
Reuse the data generation with ciar_dataloader.h in Resnet

Self evaluation:

Build test:	 [X]Passed [ ]Failed [ ]Skipped
Run test:	 [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: jijoong.moon<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #1945. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.

:octocat: cibot: @jijoongmoon, A builder checker could not be completed because one of the checkers is not completed. In order to find out a reason, please go to http://ci.nnstreamer.ai/nntrainer/ci/repo-workers/pr-checker/1945-202206271938180.25174808502197-e88dbee2944fc359a4b152e9f2df64209ef54c5e/.