Ability to add custom handlebars helpers

Thanks for your work on raml2html, it's one of the main reasons we chose RAML over swagger. Having dug into the code a little, I see it's an extremely powerful tool. I copied the templates and swapped the example and schemas to put examples first. Took 5 minutes, thanks for making life easy. :+1:
I'd like to (eventually) get around to rendering our JSON schemas a little more prettily. Is there any way I could use raml2html and add my own handlebars helper to render the JSON schema? I could fork the code and modify it directly, but that feels like a nightmare to maintain, etc.
If this is not currently possible, consider this a feature request. :-) You open to a PR if we implement this ourselves?

I've also found it necessary to add helpers and am already seeing how difficult it will be to merge in upstream changes, so a clean way to add helpers would be very nice!

Adding helpers is very easy as long as you use raml2html as a library (as opposed to running it from the command line which uses the default config and templates).
Please see https://github.com/kevinrenskers/raml2html/blob/master/examples/script.js for examples about running raml2html as a lib. The config object that you pass to raml2html.render simply needs a helpers object: https://github.com/kevinrenskers/raml2html/blob/master/lib/raml2html.js#L113

Of course if you want to modify the default templates with your own helpers yet at the same time stay up to date with upstream changes in the default templates.. I don't have a solution for that. You either use the supplied templates or you don't :)
Not sure if this answers your question? And yeah PR's are always welcome!

Closing this issue, please let me know if I can be of more help or if I misunderstood your question.

Thanks for raml2html as well. I'm also interested in adding helpers. Could you maybe give an actual example on how a helper is passed via the config object?

The raml2html.render function needs a config object. That object can have a property called helpers, which is an object with named functions. Check how the getDefaultConfig function does it: https://github.com/kevinrenskers/raml2html/blob/master/lib/raml2html.js#L117-L158
So you could add to this..
var config = raml2html.getDefaultConfig();
config.helpers['mycustomhelper'] = function(options) { ... }

Or just create your own config object from scratch
var config = {
    template: '
Hello!
',
    helpers: {
        mycustomhelper: function(options) {
            ...
        }
    }
}

Please check the example script and the source code of raml2html as well.


Write About CI/DC

Write about Environments, GitHub Actions & their triggers as well as automated testing and CI/CD pipeline in 5. Configuration Management > 5.4 System Building

Part of #23

I wrote a bit about it in System Building. More can be added when we establish more to the flow itself. Like how exactly the deployment would work


Commits to the planetary-data-engine repo cannot be merged due to CI/CD build error related to sphinx

Checked for duplicates
Yes - I've already checked
🐛 Describe the bug
When I commit to my own branch (sinequa-api-notebook) in the planetary-data-engine repo the automated CI/CD workflow gets the following error: error: invalid command 'build_sphinx'.  The relevant lines in the log are:
docs: commands[0]> python setup.py build_sphinx
/home/runner/work/planetary-data-engine/planetary-data-engine/.tox/docs/lib/python3.9/site-packages/setuptools/config/setupcfg.py:293: _DeprecatedConfig: Deprecated config in `setup.cfg`
!!

        ********************************************************************************
        The namespace_packages parameter is deprecated, consider using implicit namespaces instead (PEP 420).

          This error is in a part of the repo that I don't touch.
📜 To Reproduce

Push any commit to a branch in the repo.
Wait a few minutes for an email referencing Run failed: Branch integraion testing
Click the link in the email or navigate directly to view the workflow run.  Check the logs carefully to find the error.

🖥 Environment Info

git version 2.39.3
Operating System: MacOSX Venture 13.6

📚 Version of Software Used

git version 2.39.3

🩺 Test Data / Additional context
No response
🦄 Related requirements
No response
⚙ Engineering Details
No response

Hi @jjacob7734, to quickly get some docs built, try:
sphinx-build docs/source docs/build
open docs/build/index.html

However, the real problem is that it looks like Sphinx is not installing a setup.py extension command to build the docs. This is because in your setup.cfg you have sphinx listed without a version pin, which means "grab me the latest".
The Python template repo uses sphinx~=3.2.1. If I add that to your setup.cfg, then I get python setup.py build_sphinx—but it fails because the Jinja2 dependency is also too high. If I also add Jinja2<3.1, then python setup.py build_sphinx works fine.
In fact, you'll probably want to pin all your dev dependencies in order to avoid the version confusion security vulnerability. Here are the correct pins to use from the Python template repo:
black~=23.7.0
flake8~=6.1.0
flake8-bugbear~=23.7.10
flake8-docstrings~=1.7.0
pep8-naming~=0.13.3
mypy~=1.5.1
pydocstyle~=6.3.0
coverage~=7.3.0
pytest~=7.4.0
pytest-cov~=4.1.0
pytest-watch~=4.2.0
pytest-xdist~=3.3.1
pre-commit~=3.3.3
sphinx~=3.2.1
sphinx-rtd-theme~=0.5.0
tox~=4.11.0
types-setuptools~=<IP_ADDRESS>
Jinja2<3.1

@nutjob4life  committed the fix for this to the sinequa-api-notebook branch to be merged.

Hi @jjacob7734, to quickly get some docs built, try:
sphinx-build docs/source docs/build
open docs/build/index.html

However, the real problem is that it looks like Sphinx is not installing a setup.py extension command to build the docs. This is because in your setup.cfg you have sphinx listed without a version pin, which means "grab me the latest".
The Python template repo uses sphinx~=3.2.1. If I add that to your setup.cfg, then I get python setup.py build_sphinx—but it fails because the Jinja2 dependency is also too high. If I also add Jinja2<3.1, then python setup.py build_sphinx works fine.
In fact, you'll probably want to pin all your dev dependencies in order to avoid the version confusion security vulnerability. Here are the correct pins to use from the Python template repo:
black~=23.7.0
flake8~=6.1.0
flake8-bugbear~=23.7.10
flake8-docstrings~=1.7.0
pep8-naming~=0.13.3
mypy~=1.5.1
pydocstyle~=6.3.0
coverage~=7.3.0
pytest~=7.4.0
pytest-cov~=4.1.0
pytest-watch~=4.2.0
pytest-xdist~=3.3.1
pre-commit~=3.3.3
sphinx~=3.2.1
sphinx-rtd-theme~=0.5.0
tox~=4.11.0
types-setuptools~=<IP_ADDRESS>
Jinja2<3.1


Quantizing q8p

I was quantizing weights using :
graph.openStore(
  full_f16_path, flags: .truncateWhenClose
) { store in
  let keys = store.keys
  graph.openStore(
    f8_path,
    flags: .truncateWhenClose
  ) {
    for key in keys {
      guard let tensor = store.read(key) else { continue }

      print("quantizing  \(key) \(tensor)")

      $0.write(key, tensor: tensor, codec: [.q8p ])
    }
  }
}

but it looks like some params with less number of elements are not being quantized. Like layers with 320 params.
did you add a check or something? where is it ?

That's correct. We check if quantized size will be smaller than the original size, only if so we do the quantization. q8p uses a look-up table of 256 elements (of FP16). So anything less than 256 + 128 elements will be not useful with quantization.
Also, there are limitations on kernels (for example, our layer norm / rms norm kernels on CUDA don't support quantized tensors (for scale / bias), and our GEMM / convolution kernels on both CUDA and Metal don't support quantized bias) to make sure prefer only quantize weight matrix, see code here: https://github.com/drawthingsai/draw-things-community/blob/main/Apps/ModelQuantizer/Quantizer.swift#L34

Thanks a lot

Actually it only happens for CUDA. for mps, it is still quantizing the layers with 320 params.

@liuliu  i am trying to disable it so that even small tensors get quantized. But after removing the guard, it gives illegal memory access on CUDA.

Actually it only happens for CUDA. for mps, it is still quantizing the layers with 320 params.
Not certain. One the quirk of our quantization is that depending on the original tensor, the LUT table can be either in FP32 or in FP16. That's why in production code, we first convert to Float16 and then save the quantization result write("key", tensor: Tensor<Float16>(from: originalTensor), codec: [.q8p, .ezm7]).

There will be more to be changed if you deliberately want the quantized tensor to be bigger than the un-quantized ones because we always assumed the data size of the payload will be at most the un-quantized tensor size (i.e. number of elements * sizeof(float or float16)). If it is bigger, there are some allocations are not large enough and will cause mem overflow errors elsewhere.


Update request: where-is-my-sddm-theme 1.5.1 → 1.6.0

Package name: where-is-my-sddm-theme
Latest released version: 1.6.0

Current version on the unstable channel: 1.5.1
Current version on the stable/release channel: 1.5.1

[x] Checked the nixpkgs pull requests

Notify maintainers
@name-snrl

Note for maintainers: Please tag this issue in your PR.

Add a :+1: reaction to issues you find important.

#276610


Fix time conversion

Closing this out since I think we stumbled on this around the same time and it's already fixed in mainline.


Docker: use openjdk:8-jre-alpine

java:8-jre-alpine is deprecated

OK to merge?

Yes sorry, ran the test, but forgot to merge.

No pb. Not sure you had seen it. Thanks for having a look.
2016-09-30 11:52 GMT+02:00 Clement Escoffier<EMAIL_ADDRESS>
Yes sorry, ran the test, but forgot to merge.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/vert-x3/vertx-stack/pull/53#issuecomment-250705614,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABbltoAnEsnsVI6FQuiDyK1tYRGagxxKks5qvNvigaJpZM4KHgv4
.


ffi: socket poll not working with flutter CLI tool

Steps to Reproduce

Run flutter create --template=plugin --platforms=android,ios ffi_bug.
Create android/CMakeLists.txt file

cmake_minimum_required(VERSION 3.4.1)

add_library(native_poll
			SHARED
			../ios/Classes/native_poll/native_poll.c)

Add following lines to android section of build.gradle

externalNativeBuild {
  cmake {
    path "CMakeLists.txt"
  }
}

Create ios/Classes/native_poll/native_poll.c

#include <stdio.h>
#include <unistd.h>
#include <sys/poll.h>
#include <sys/socket.h>
#include <netinet/in.h>
#include <errno.h>

#define TIMEOUT 5

int native_poll(void) {
    int sock_fd;
    struct pollfd fds[1];
    int rc;

    sock_fd = socket(AF_INET, SOCK_STREAM, 0);

    struct sockaddr_in sin;
    sin.sin_family = AF_INET;
    sin.sin_port = htons(80);
    sin.sin_addr.s_addr = inet_addr("<IP_ADDRESS>");
    if (connect(sock_fd, (struct sockaddr*)(&sin),
            sizeof(struct sockaddr_in)) != 0) {
        fprintf(stderr, "Failed to establish socket connection!\n");
        return -1;
    }

    /* watch socket for input */
    fds[0].fd = sock_fd;
    fds[0].events = POLLIN;
    fds[0].revents = 0;

    rc = poll(fds, 1, TIMEOUT * 1000);

    if (rc == 0) {
        fprintf(stderr, "%d seconds elapsed.\n", TIMEOUT);
        return -2;
    }

    if (rc == -1) {
        fprintf(stderr, "Poll error. errno: %i", errno);
        return errno;
    }

    if (fds[0].revents & POLLIN)
        fprintf(stdout, "socket is readable\n");

    return 0;
}

Replace code in lib/ffi_bug.dart with

import 'dart:ffi' as ffi;
import 'dart:io';

ffi.DynamicLibrary nativeLib = Platform.isAndroid
    ? ffi.DynamicLibrary.open('libnative_poll.so')
    : ffi.DynamicLibrary.process();

typedef native_poll = ffi.Int8 Function();
typedef NativePoll = int Function();

NativePoll nativePoll = nativeLib
    .lookup<ffi.NativeFunction<native_poll>>('native_poll')
    .asFunction();

Add internet permission to example app in example/android/app/src/main/AndroidManifest.xml
Replace code in example/lib/main.dart with

import 'package:flutter/material.dart';
import 'package:ffi_bug/ffi_bug.dart';

void main() {
  runApp(MyApp());
}

class MyApp extends StatefulWidget {
  @override
  _MyAppState createState() => _MyAppState();
}

class _MyAppState extends State<MyApp> {
  int _rc;

  @override
  void initState() {
    super.initState();
    _nativePoll();
  }

  void _nativePoll() {
    var rc = nativePoll();
    setState(() {
      _rc = rc;
    });
  }

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      home: Scaffold(
        appBar: AppBar(
          title: const Text('FFI Bug'),
        ),
        body: Center(
          child: Text('native_poll returned: $_rc\n'),
        ),
        floatingActionButton: FloatingActionButton(
          onPressed: _nativePoll,
          child: Icon(Icons.bug_report),
        ),
      ),
    );
  }
}

Run cd example.
Ensure stable internet connection.

Expected results:
Run flutter run --release. The return code will be -2 (or 0 depending on the service running behind the provided port and ip-address) indicating that either no write event occured within the specified timeout period or an event was received. In either case, the poll function was completed without interruption.
Actual results:
Run flutter run. The native_poll function will immediately return 4, indicating a system interruption.
This behavior appears to be independent of the gradle build variant configuration as building the app's debug version using Android Studio works as expected.

Logs
[✓] Flutter (Channel stable, 2.0.6, on Microsoft Windows [Version 10.0.19042.928], locale de-DE)
    • Flutter version 2.0.6 at C:\flutter
    • Framework revision 1d9032c7e1 (2 weeks ago), 2021-04-29 17:37:58 -0700
    • Engine revision 05e680e202
    • Dart version 2.12.3

[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.2)
    • Android SDK at C:\Users\Dell-User\AppData\Local\Android\sdk
    • Platform android-30, build-tools 29.0.2
    • Java binary at: C:\Program Files\Android\Android Studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6842174)
    • All Android licenses accepted.

[✓] Chrome - develop for the web
    • Chrome at C:\Program Files (x86)\Google\Chrome\Application\chrome.exe

[✓] Android Studio (version 4.1.0)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6842174)

[✓] VS Code
    • VS Code at C:\Users\Dell-User\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.14.1

[✓] VS Code, 64-bit edition (version 1.56.0)
    • VS Code at C:\Program Files\Microsoft VS Code
    • Flutter extension version 3.14.1

[✓] Connected device (3 available)
    • ONEPLUS A3003 (mobile) • f1e37f9c • android-arm64  • Android 9 (API 28)
    • Chrome (web)           • chrome   • web-javascript • Google Chrome 90.0.4430.212
    • Edge (web)             • edge     • web-javascript • Microsoft Edge 90.0.818.56

• No issues found!

Hi @LucasAschenbach
Thanks for filing the issue and detail coding steps, I can reproduce the issue, it returns 4  on multiple channels
Reproduced on the following channels

stable
master

✅
✅

Check flutter doctor -v outputs for each channel below

flutter doctor -v
[✓] Flutter (Channel stable, 2.0.6, on Microsoft Windows [Version 10.0.19042.928], locale en-US)
    • Flutter version 2.0.6 at C:\Users\Taha\Code\flutter_stable
    • Framework revision 1d9032c7e1 (2 weeks ago), 2021-04-29 17:37:58 -0700
    • Engine revision 05e680e202
    • Dart version 2.12.3

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at C:\Users\Taha\Code\SDK
    • Platform android-30, build-tools 30.0.3
    • ANDROID_SDK_ROOT = C:\Users\Taha\Code\SDK
    • Java binary at: C:\Users\Taha\Code\android-studio\jre\bin\java.exe
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6842174)
    • All Android licenses accepted.

[✓] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[✓] Visual Studio - develop for Windows (Visual Studio Community 2019 16.9.4)
    • Visual Studio at C:\Program Files (x86)\Microsoft Visual Studio\2019\Community
    • Visual Studio Community 2019 version 16.9.31205.134
    • Windows 10 SDK version 10.0.19041.0

[!] Android Studio (not installed)
    • Android Studio not found; download from https://developer.android.com/studio/index.html
      (or visit https://flutter.dev/docs/get-started/install/windows#android-setup for detailed instructions).

[✓] IntelliJ IDEA Community Edition (version 2021.1)
    • IntelliJ at C:\Program Files\JetBrains\IntelliJ IDEA Community Edition 2020.3.3
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] VS Code (version 1.56.2)
    • VS Code at C:\Users\Taha\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.22.0

[✓] Connected device (4 available)
    • Android SDK built for x86 (mobile) • emulator-5554 • android-x86    • Android 10 (API 29) (emulator)
    • Windows (desktop)                  • windows       • windows-x64    • Microsoft Windows [Version 10.0.19042.928]
    • Chrome (web)                       • chrome        • web-javascript • Google Chrome 90.0.4430.212
    • Edge (web)                         • edge          • web-javascript • Microsoft Edge 90.0.818.56

! Doctor found issues in 1 category.

[✓] Flutter (Channel master, 2.3.0-2.0.pre.205, on Microsoft Windows [Version 10.0.19042.928], locale en-US)
    • Flutter version 2.3.0-2.0.pre.205 at C:\Users\Taha\Code\flutter_master
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 9108c06217 (8 hours ago), 2021-05-14 02:14:03 -0400
    • Engine revision c75ec8ea4d
    • Dart version 2.14.0 (build 2.14.0-115.0.dev)

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at C:\Users\Taha\Code\SDK
    • Platform android-30, build-tools 30.0.3
    • ANDROID_SDK_ROOT = C:\Users\Taha\Code\SDK
    • Java binary at: C:\Users\Taha\Code\android-studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6842174)
    • All Android licenses accepted.

[✓] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[✓] Visual Studio - develop for Windows (Visual Studio Community 2019 16.9.4)
    • Visual Studio at C:\Program Files (x86)\Microsoft Visual Studio\2019\Community
    • Visual Studio Community 2019 version 16.9.31205.134
    • Windows 10 SDK version 10.0.19041.0

[✓] Android Studio (version 4.2.0)
    • Android Studio at C:\Users\Taha\Code\android-studio
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.8+10-b944.6842174)

[✓] IntelliJ IDEA Community Edition (version 2021.1)
    • IntelliJ at C:\Program Files\JetBrains\IntelliJ IDEA Community Edition 2020.3.3
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] VS Code (version 1.56.2)
    • VS Code at C:\Users\Taha\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.22.0

[✓] Connected device (4 available)
    • Android SDK built for x86 (mobile) • emulator-5554 • android-x86    • Android 10 (API 29) (emulator)
    • Windows (desktop)                  • windows       • windows-x64    • Microsoft Windows [Version 10.0.19042.928]
    • Chrome (web)                       • chrome        • web-javascript • Google Chrome 90.0.4430.212
    • Edge (web)                         • edge          • web-javascript • Microsoft Edge 90.0.818.56

• No issues found!

In debug builds Dart profiler is continuously sampling the main thread using SIGPROF so EINTR is expected. You should either restart the poll after receiving EINTR or block SIGPROF for the duration of native_poll using pthread_sigmask (remember to unblock it though so that profiler continues to work once native_poll returns).


Couldn't cast array of type string error with cast_column

Describe the bug
In OVH cloud during Huggingface Robust-speech-recognition event on a AI training notebook instance using jupyter lab and running jupyter notebook When using the dataset.cast_column("audio",Audio(sampling_rate=16_000))
method I get error

This was working with datasets version 1.17.1.dev0
but now with version 1.18.3 produces the error above.
Steps to reproduce the bug
load dataset:

remove columns:

run my fix_path function.
This also creates the audio column that is referring to the absolute file path of the audio

Then I concatenate few other datasets and finally try the cast_column method

but get error:

Expected results
A clear and concise description of the expected results.
Actual results
Specify the actual results or traceback.
Environment info

datasets version: 1.18.3

Platform:
OVH Cloud, AI Training section, container for Huggingface Robust Speech Recognition event image(baaastijn/ovh_huggingface)

Python version: 3.8.8

PyArrow version:

Hi ! I wasn't able to reproduce the error, are you still experiencing this ? I tried calling cast_column on a string column containing paths.
If you manage to share a reproducible code example that would be perfect

Hi,
I think my team mate got this solved. Clolsing it for now and will reopen if I experience this again.
Thanks :)

Hi @R4ZZ3,
If it is not too much of a bother, can you please help me how to resolve this error? I am exactly getting the same error where I am going as per the documentation guideline:
my_audio_dataset = my_audio_dataset.cast_column("audio_paths", Audio())
where "audio_paths" is a dataset column (feature) having strings of absolute paths to mp3 files of the dataset.

I was having the same issue with this code:
dataset = dataset.map(
    lambda batch: {"full_path" : os.path.join(self.data_path, batch["path"])},
    num_procs = 4
)
my_audio_dataset = dataset.cast_column("full_path", Audio(sampling_rate=16_000))

Removing the "num_procs" argument fixed it somehow.
Using a mac with m1 chip


Map levels

We could add a function that would map between different taxonomic levels, for instance from genera to species, or from species to genera etc. (either way, from lower to higher levels and vice versa). This can be handy in many cases.
This would be a rough equivalent to microbiome::map_levels.R.

bumping this. Any additional information/example you can provide?

Thanks - we frequently need to ask

what more refined groups (ASVs, species..) are included in a particular phylum or family
what is the corresponding phylum (or other higher level) for a given ASV, species or genus

We use this frequently in miscellaneous data wrangling & interpretation tasks, there is microbiome::map_levels for phyloseq objects.
If this does not fit mia, we can consider miautilities package in a similar vein to @microsud microbiomeutilities that could have such shortcuts/wrappers for common tasks.


Bug Report: Web Version is completely broken.

Please check for duplicates, similar issues or closed issues with the same problem, as well performing simple troubleshooting steps (such as deleting the export folder if it's an issue with compiling, reinstalling Kade Engine) before submitting an issue.
If you are playing a downloaded version of the game, what operating system are you using?
Windows (x86), Windows (x86_64), Linux, or macOS? Specify below.
HTML5 on FireFox (latest version) on windows 10
What version of the game are you using? Look in the bottom left corner of the main menu.
1.6 nightly web (on funkin.puyo.xyz or smthn like that)
Have you identified any steps to reproduce the bug? If so, please describe them below. Use images if possible.
go into any song. for my case, high. then play. you wont be able to hit any notes. the arrow animations wont play on press either.
Please describe your issue. Provide extensive detail and images if possible.
see above.
(sorry for lag. im on my old laptop rn lol)
and for some reason in the video the rating isnt working either???
im also spam hitting the keys
https://user-images.githubusercontent.com/63559800/127238873-d24a0161-cc6c-4f66-9d6f-81fb1a83fe52.mp4

come again?
https://user-images.githubusercontent.com/26305836/127268884-0894314f-cb13-407c-b62f-87f362251645.mp4

then its probably my pc or firefox having a stroke with input. sorry for wasting your time!


Fixed illustration of in-memory format of environment strings.

Confirmed in both ANSI and UNICODE version of the function.

@ai4rei : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@Karl-Bridge-Microsoft : Thanks for your contribution! The author(s) have been notified to review your proposed change.


nextcloud: 20.0.4 -> 20.0.5

Signed-off-by: Robbert Gurdeep Singh<EMAIL_ADDRESS>
Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@ofborg test nextcloud20

@ofborg test nextcloud20

Will test-deploy it to my instance and merge/backport after that.

Will test-deploy it to my instance and merge/backport after that.

Ported to stable as 0e2832d592e999feb7b5df0e574a29c342970e4b.

Ported to stable as 0e2832d592e999feb7b5df0e574a29c342970e4b.


MudBlazor doesn't work in InteractiveWebAssembly mode

Things to check

[X] I have searched the existing issues for this bug
[X] To rule out a caching problem I made sure the bug also happens in an incognito tab

Bug type
Component, Docs (mudblazor.com)
Component name
Snackbar
What happened?
I have a component (a page) that runs in InteractiveWebAssembly mode, and wanted to show Snackbar. In some configurations nothing happens, in other I get a info that I need to add Popover to layout (which is actually added).
Expected behavior
MudBlazor components should work no matter the rendering mode.
Reproduction link
https://try.mudblazor.com/snippet/QYGIEtcyoxfiMnLd
Reproduction steps
This is my layout code:
@inherits LayoutComponentBase

<MudThemeProvider />
<MudPopoverProvider />
<MudDialogProvider />
<MudSnackbarProvider />

<MudLayout>
    <MudAppBar>
        <MudNavLink Href="/">My App</MudNavLink>
    </MudAppBar>
    <MudMainContent Class="main">
        <MudPaper class="left" Outlined>Menu</MudPaper>

@Body

    </MudMainContent>
    <MudPaper class="footer" Style="@($"background-color: {Colors.Shades.Black}")">Footer</MudPaper>
</MudLayout>

    An unhandled error has occurred.
    Reload
    🗙

And my Page code:
@page "/counter"
@rendermode InteractiveWebAssembly
@inject ISnackbar Snackbar

<PageTitle>Counter</PageTitle>

Counter

Current count: @currentCount

<button class="btn btn-primary" @onclick="IncrementCount">Click me</button>

@code {
    private int currentCount = 0;

    private void IncrementCount()
    {
        currentCount++;
        Snackbar.Add($"Counter clicked {currentCount} times", Severity.Info);
    }
}

And my App component:
<!DOCTYPE html>

    <meta charset="utf-8" />
    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
    <base href="/" />
    <link rel="stylesheet" href="bootstrap/bootstrap.min.css" />
    <link rel="stylesheet" href="app.css" />
    <link rel="stylesheet" href="MudBlazorTesting.styles.css" />
    <link href="https://fonts.googleapis.com/css?family=Roboto:300,400,500,700&display=swap" rel="stylesheet" />
    <link href="_content/MudBlazor/MudBlazor.min.css" rel="stylesheet" />
    <link rel="icon" type="image/png" href="favicon.png" />
    <HeadOutlet />

    <Routes  />

Relevant log output
No response
Version (bug)
7.8.0
Version (working)
No response
What browsers are you seeing the problem on?
Edge
On which operating systems are you experiencing the issue?
Windows
Pull Request

[ ] I would like to do a Pull Request

Code of Conduct

[X] I agree to follow this project's Code of Conduct

If you're using Per page interactive rendering mode you need to include the providers on every interactive page:
@page "/counter"
@rendermode InteractiveWebAssembly
@inject ISnackbar Snackbar

<MudSnackbarProvider /> <-- add this

<PageTitle>Counter</PageTitle>

Counter

Current count: @currentCount

<button class="btn btn-primary" @onclick="IncrementCount">Click me</button>

@code {
    private int currentCount = 0;

    private void IncrementCount()
    {
        currentCount++;
        Snackbar.Add($"Counter clicked {currentCount} times", Severity.Info);
    }
}

If you're using Per page interactive rendering mode you need to include the providers on every interactive page:

That's correct. This is what the per page interactivity is about.
As alternative, use global render mode, then you need to include them only in the mainlayout.
Will wait for the author feedback and then close the issue.

OK, thanks for quick response. You can close the issue. I assumed it should work like that.


[BUG] Bad performance with links in table

Describe the bug
Links are a very cool feature but on my Mac/iterm2 they seem to have a really bad impact on the rendering performance of a table. I found out about that problem while I implemented to add a new feature (clickable links) to a project of mine (pyfahrplan) that I migrated from tabulate to rich yesterday. In order to make sure that the issue is Python version independent, I created two small example files and ran them with Python 3.8, 3.10, 3.11a2 with comparable results.
So here is a fast version without links including profiling:
import cProfile
import pstats

from rich.console import Console
from rich.table import Table

def print_table():
    console = Console()
    table = Table(
        title=f"Rich table without links",
        show_lines=True
    )
    table.add_column("Column")
    for row in range(1000):
        table.add_row(str(row))
    console.print(table)

if __name__ == "__main__":
    profiler = cProfile.Profile()
    profiler.enable()
    print_table()
    profiler.disable()
    stats = pstats.Stats(profiler).sort_stats('tottime')
    stats.print_stats()

with the following relevant profiler result:
         580320 function calls (562781 primitive calls) in 0.170 seconds

   Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
        1    0.009    0.009    0.009    0.009 {method 'write' of '_io.TextIOWrapper' objects}

And here a slow version with links inside the table:
import cProfile
import pstats

from rich.console import Console
from rich.table import Table

def print_table():
    console = Console()
    table = Table(
        title=f"Rich table with links",
        show_lines=True
    )
    table.add_column("Column")
    for row in range(1000):
        table.add_row(f"[link=https://github.com/{row}]row {row}[/link]")
    console.print(table)

if __name__ == "__main__":
    profiler = cProfile.Profile()
    profiler.enable()
    print_table()
    profiler.disable()
    stats = pstats.Stats(profiler).sort_stats('tottime')
    stats.print_stats()

with the following relevant profiler result:
        769800 function calls (752067 primitive calls) in 6.879 seconds

   Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
        1    6.637    6.637    6.637    6.637 {method 'write' of '_io.TextIOWrapper' objects}

Platform
What platform (Win/Linux/Mac) are you running on? What terminal software are you using?
Mac M1 (Macbook Air), iterm2, I tried python 3.8, 3.10, 3.11a2. The behaviour inside the "normal" Mac Terminal.app is much faster, but this app is not able to display links. I think I remember hearing about this feature disabling behaviour of rich in a podcast, so I think the relevant code is just not executed.
I may ask you to cut and paste the output of the following commands. It may save some time if you do it now.
python -m rich.diagnose
╭───────────────────────── <class 'rich.console.Console'> ─────────────────────────╮
│ A high level console interface.                                                  │
│                                                                                │
│ ╭──────────────────────────────────────────────────────────────────────────────╮ │
│ │ <console width=103 ColorSystem.TRUECOLOR>                                    │ │
│ ╰──────────────────────────────────────────────────────────────────────────────╯ │
│                                                                                │
│     color_system = 'truecolor'                                                   │
│         encoding = 'utf-8'                                                       │
│             file = <_io.TextIOWrapper name='<stdout>' mode='w' encoding='utf-8'> │
│           height = 52                                                            │
│    is_alt_screen = False                                                         │
│ is_dumb_terminal = False                                                         │
│   is_interactive = True                                                          │
│       is_jupyter = False                                                         │
│      is_terminal = True                                                          │
│   legacy_windows = False                                                         │
│         no_color = False                                                         │
│          options = ConsoleOptions(                                               │
│                        size=ConsoleDimensions(width=103, height=52),             │
│                        legacy_windows=False,                                     │
│                        min_width=1,                                              │
│                        max_width=103,                                            │
│                        is_terminal=True,                                         │
│                        encoding='utf-8',                                         │
│                        max_height=52,                                            │
│                        justify=None,                                             │
│                        overflow=None,                                            │
│                        no_wrap=False,                                            │
│                        highlight=None,                                           │
│                        markup=None,                                              │
│                        height=None                                               │
│                    )                                                             │
│            quiet = False                                                         │
│           record = False                                                         │
│         safe_box = True                                                          │
│             size = ConsoleDimensions(width=103, height=52)                       │
│        soft_wrap = False                                                         │
│           stderr = False                                                         │
│            style = None                                                          │
│         tab_size = 8                                                             │
│            width = 103                                                           │
╰──────────────────────────────────────────────────────────────────────────────────╯
python -m rich._windows
platform="Darwin"
WindowsConsoleFeatures(vt=False, truecolor=False)
pip freeze | grep rich
rich==10.16.1

Update: I created an even smaller example without tables:
import cProfile
import pstats

from rich.console import Console
from rich.text import Text

def print_text():
    console = Console()
    text = Text()
    text = "\n".join(
        [f"[link=https://github.com/{row}]text {row}[/link]" for row in range(1000)]
    )
    console.print(text)

if __name__ == "__main__":
    profiler = cProfile.Profile()
    profiler.enable()
    print_text()
    profiler.disable()
    stats = pstats.Stats(profiler).sort_stats('tottime')
    stats.print_stats()

The majority of the time is spent in write method of the stdout file. By that point Rich has generated the text of the entire table. This tells me it's the system level that is slow, likely the terminal itself.
Rich generates the same output on terminals which don't support links. The link spec is backwards compatible, and terminals will just ignore those extra codes.
You can validate this by setting file=io.Stringio() on the Console instance, which will render the output to memory only. You should find that without the terminal in the middle this is much faster.
I couldn't say why it is taking so long. Some extra validation maybe. I really hope it is not doing a dns lookup on those urls.

I will dig a little deeper. Fortunately, it has not been DNS :D

I will close here. It seems to be an issue with iTerm2 (perhaps with my configuration) and I was able to reproduce the same slow behaviour using, so it is definitively not a rich issue.
for x in range(1000):
    print(f"\x1b]8;;http://example{x}.com/\aCtrl+Click here\x1b]8;;\a")


Clarifications regarding PromptLoginBehavior

Hi,
Would need some clarification on the different settings for the PromptLoginBehavior parameter and their meaning.
It is stated that the NativeSupport is the recommended value, is it actually that? Default is  and I havent seen any AD FS setups using that value.
Default is  and If you configure it to something else, how do you revert back to ???
Have tested in lab but haven't been able to set it to  or $null
Or do you configure it as TranslateToFreshPasswordAuth and is that then exactly the same as  setting?
If configured as:

NativeSupport, what does it mean in practise? wauth = ??? and wfresh=???
Disabled, what does it mean in practise? wauth = nothing and wfresh=0

From MicrosoftDocs

TranslateToFreshPasswordAuth:
means the default Azure AD behavior of translating prompt=login to wauth=https://schemas.microsoft.com/ws/2008/06/identity/authenticationmethod/password and wfresh=0.

NativeSupport:
means that the prompt=login parameter will be sent as is to AD FS. This is the recommended value if AD FS is in Windows Server 2012 R2 with the July 2016 update rollup or higher.

Disabled:
means that only wfresh=0 is sent to AD FS.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0eaa668f-880c-8415-17bb-8169fe23fd26
Version Independent ID: fe5d3e99-46fc-6daf-a8af-5b0653d500f7
Content: AD FS prompt=login
Content Source: WindowsServerDocs/identity/ad-fs/operations/AD-FS-Prompt-Login.md
Product: windows-server
Technology: ad-fs
GitHub Login: @billmath
Microsoft Alias: billmath

We hugely appreciate your contribution, feedback, and support to our technical documentation.
We’ve phased out GitHub Issues on this repository as the feedback mechanism for content and have replaced it with a new feedback system. For more information see, Content User Feedback. As part of this rollout, we are migrating your issue where our team will use your comments to improve the documentation experience. Unfortunately, this does mean you won't be able to access this issue after the migration is complete.
All issues will be migrated by Thursday 29th August 2024.
Once again, thank you for your valuable feedback, we hope you’ll continue to contribute using our new feedback system.


Filter topics languages articles

Bug/issue #, if applicable: rdar://90159299
Summary
As a follow-up to #96, fixes an issue where variants of multi-language articles display APIs that are not available in the language variant. This fix makes DocC only display the APIs available in the language of the currently-selected language. For example, this fix makes DocC omit a Swift-only API from the Objective-C variant of an article that curates it.
I've broken up the changes in three commits:

The first commit adds map APIs to the VariantCollection family of types, to make it easier to update values in variant collections. This functionality is required for the next commit.
The actual fix which encodes topics sections on a per-variant basis, and fixes an issue where non-default variants of empty topic sections are encoded as [] instead of not at all.
Resolves the same issue, but for See Also sections.

Note: I noticed that automatically curated See Also sections for both articles and symbols don't get the filtering treatment. I will fix this in a follow-up PR.
Dependencies
None.
Testing
When building documentation for an article that curates symbols, verify that the render JSON topics and sections for each language variant only contain APIs that are available in that language. Also, verify the same behavior for automatically curated See Also sections.
Checklist
Make sure you check off the following items. If they cannot be completed, provide a reason.

[x] Added tests
[x] Ran the ./bin/test script and it succeeded
[x] Updated documentation if necessary

@swift-ci please test

@swift-ci please test

@swift-ci please test

@swift-ci please test


feat(zipkin) override unknown-service-name

Optional configurable field to enable setting a defaulted service name in the zipkin spans to replace the unknown-service-name existing behavior,
Fixes: #39
Fixes: #23 (I think if I am reading it correctly)
I defaulted the string to nil as to not change any behavior of the plugin by default. Could easily set default to "Kong" if that is preferred but that would change default behavior so I didn't commit it like that.

Hmm the spacing looks 1 off in a spot, yet when I go to actually view the file it seems fine: https://github.com/Kong/kong-plugin-zipkin/blob/4a7f5f0a1325150bd6298392680b77b080bc2024/kong/plugins/zipkin/reporter.lua

Yeah we use this internally on a fork. Thought to drop it by 😁 .

looks sensible

@jeremyjpj0916 could you please rebase this to get the conflict solved? I will be merging this and releasing a new version then.

Meh, closing this one for: https://github.com/Kong/kong-plugin-zipkin/pull/45 , was easier for me.


Folder contents no longer displaying

What system are you running Yazi on?
Linux X11
What terminal are you running Yazi in?
kitty 0.35.2
Did you try the latest code to see if this problem got fixed?
Tried, but the problem still
yazi --debug output

Yazi
    Version: 0.2.5 (VERGEN_IDEMPOTENT_OUTPUT 2024-07-01)
    OS: linux-x86_64 (unix)
    Debug: false
Emulator
Emulator.via_env: ("xterm-kitty", "")
Emulator.via_csi: Ok(Kitty)
Emulator.detect: Kitty
Adaptor
Adaptor.matches: Kitty
Desktop
XDG_SESSION_TYPE: Some("x11")
WAYLAND_DISPLAY: None
DISPLAY: Some(":0")
SSH
shared.in_ssh_connection: false
WSL
/proc/sys/fs/binfmt_misc/WSLInterop: false
Variables
SHELL: Some("/bin/bash")
EDITOR: Some("nvim")
ZELLIJ_SESSION_NAME: None
YAZI_FILE_ONE: None
YAZI_CONFIG_HOME: None
file(1)
Version: Ok(Output { status: ExitStatus(unix_wait_status(0)), stdout: "file-5.41\nmagic file from /etc/magic:/usr/share/misc/magic\n", stderr: "" })
Text Opener
default: Some(Opener { run: "nvim "$@"", block: true, orphan: false, desc: "nvim", for_: None, spread: true })
block: Some(Opener { run: "nvim "$@"", block: true, orphan: false, desc: "nvim", for_: None, spread: true })
tmux
TMUX: false
Ueberzug++
Version: Err(Os { code: 2, kind: NotFound, message: "No such file or directory" })
Describe the bug
With latest version the contents of directories no longer display. The same version with the same config on my laptop runing Debian 12 behaves properly.
Expected Behavior
When focused on a directory the files in the directory should display in the pane to the right
To Reproduce
HIghlight a directory in yazi
Configuration
No response
Anything else?
No response

Also see this repeated error in yazi.log:
2024-07-01T19:26:48.284843Z ERROR yazi_plugin::isolate::peek: runtime error: [string "/home/bert/.cargo/registry/src/index.crates.i..."]:56: attempt to index a nil value (local 'child')
stack traceback:
[string "/home/bert/.cargo/registry/src/index.crates.i..."]:56: in function <[string "/home/bert/.cargo/registry/src/index.crates.i..."]:28>
at /home/bert/.cargo/registry/src/index.crates.io-6f17d22bba15001f/yazi-plugin-0.2.5/src/isolate/peek.rs:50

Is it still without any config? If not please upload your ~/.config/yazi

Just tried with no config and the problem is not there. So it must be somewhere in my config. The strange thing is that I have the identical config on my laptop and the problem is not there.
Attached is my config.
On Mon, Jul 1, 2024, at 18:07, 三咲雅 · Misaki Masa wrote:

Is it still without any config? If not please upload your ~/.config/yazi
—
Reply to this email directly, view it on GitHub https://github.com/sxyazi/yazi/issues/1244#issuecomment-2201590813, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALLYYROY33CEFIMVBDFM22DZKH4OJAVCNFSM6AAAAABKGE67HOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBRGU4TAOBRGM.
You are receiving this because you authored the thread.Message ID: @.***>

I can't see any attached config

I found the problem. It was in my yazi.toml, not yazi itself. Thanks for the reply. All is well now.
On Tue, Jul 2, 2024, at 06:48, 三咲雅 · Misaki Masa wrote:

I can't see any attached config
—
Reply to this email directly, view it on GitHub https://github.com/sxyazi/yazi/issues/1244#issuecomment-2203220619, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALLYYRPITJM2W42U2QNMDBDZKKVRJAVCNFSM6AAAAABKGE67HOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBTGIZDANRRHE.
You are receiving this because you authored the thread.Message ID: @.***>

Alright lets close this issue then

Thanks. Sorry for the bother. It was my problem. I was away for 2 months. I did a lot of modifications with yazi. I had added the eza plugin. When I copied everything to my desktop I forgot to install eza. So yazi was calling a non-existent program. When I installed eza on my desktop everything worked as it should.
Really appreciate your work on yazi. It's the BEST>
On Tue, Jul 2, 2024, at 06:56, 三咲雅 · Misaki Masa wrote:

Alright lets close this issue then
—
Reply to this email directly, view it on GitHub https://github.com/sxyazi/yazi/issues/1244#issuecomment-2203257454, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALLYYROP7IPAJJCBMLXX3T3ZKKWQHAVCNFSM6AAAAABKGE67HOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBTGI2TONBVGQ.
You are receiving this because you authored the thread.Message ID: @.***>


Different behavior tf.contrib.data.Dataset.unbatch() TF ver. 1.2.1 and ver 1.3.0-rc0

Code for reproduce problem:
import tensorflow as tf
print(tf.__version__)
dataset = (tf.contrib.data.Dataset.range(10)
           .batch(5)
           .unbatch())
iterator = dataset.make_initializable_iterator()
print(iterator.get_next())

results in TF ver. 1.2.1:
1.2.1
Tensor("IteratorGetNext:0", shape=(), dtype=int64)

results in TF ver. 1.3.0-rc0:
1.3.0-rc0
(<tf.Tensor 'IteratorGetNext:0' shape=() dtype=int64>,)

@ebrevdo I've tried and failed to track down the commit that modified the behavior of Dataset.unbatch(), but it looks like we're inappropriately converting single-component datasets to tupled datasets. Can you please take a look?

I remember that change. I'll point you to it when at a computer.
On Jul 21, 2017 7:21 AM, "Derek Murray"<EMAIL_ADDRESS>wrote:

@ebrevdo https://github.com/ebrevdo I've tried and failed to track down
the commit that modified the behavior of Dataset.unbatch(), but it looks
like we're inappropriately converting single-component datasets to tupled
datasets. Can you please take a look?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/11666#issuecomment-317014116,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABtim4MOtOAFzqbhi1n4iSOQHK6UlRUZks5sQLP1gaJpZM4OfVgQ
.


Feature request: register new templates

Currently all templates are hardcoded and there is no way to register your own template. This would be very nice and useful.

+1

https://sandpack.codesandbox.io/docs/getting-started/usage#files


Fix exceptions when parsing falkorCache.

Fix exceptions when parsing falkorCache.
For some reason we get something like:
{"focalPoint":"{"x":0.4104,"y":0.4472}"
Which is obviously invalid. The substitution should change it to:
{"focalPoint":{"x":0.4104,"y":0.4472}
Types of changes

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[X] I have read the CONTRIBUTING document.

All Submissions:

[X] Have you followed the guidelines in our Contributing document?
[X] Have you checked to ensure there aren't other open Pull Requests for the same update/change?

Changes to Core Features:

[X] Have you added an explanation of what your changes do and why you'd like us to include them?
[X] Have you successfully ran tests with your changes locally?

@vo42 there have been done changes regarding falkorcache formatting in the last commit.
can you pls try if 0.13.6 solves your issues?

duplicate / obsolete (#380 )


Change kpt live prune algorithm to use one inventory object

Update the kpt live apply prune algorithm to use one inventory object instead of many

https://github.com/kubernetes-sigs/cli-utils/pull/194

https://github.com/kubernetes-sigs/cli-utils/pull/211

https://github.com/kubernetes-sigs/cli-utils/pull/209


Tried to Log in with Steemit Creds.

Unexpected token < in JSON at position 0
http://www.200social.com/wp-content/uploads/2017/01/Busy.org_.png

which browser ?
do you use TOR ?

Hi Guys
I use Chrome for my browsing. No Tor.
Cheers,
Randy Hilarski
High Impact Media Group Panama
http://www.highimpactmediagrouppanama.com/
LinkedIn http://pa.linkedin.com/in/randyhilarski
On Sun, Jan 22, 2017 at 1:26 PM, mynameisek<EMAIL_ADDRESS>wrote:

which browser ?
do you use TOR ?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/adcpm/busy/issues/269#issuecomment-274348722, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AQpqyqCCKoIxpWB78m0VT4jSM5ZhsuGGks5rU58-gaJpZM4LqZdq
.

yeah, I've been having the same problem with steemconnect even with the demo account (@alexpmorris).  no TOR or proxy either.  Tried in chrome 32-bit, latest chrome 64-bit, and firefox - steemconnect acts the same way on all three.  However, firefox doesn't even bring up app.busy.org - returns a blank page, though it looks fine on chrome (though, not logged in of course).

did you guys just change something?  I was trying to trace through the js code and suddenly it started saying "Invalid Password".  Next time I tried with the correct one, it worked -- I'm now logged into app.busy!

Hey we had an issue we restarted the server and it's working again. We are still looking into it.

@RandyHilarski Can you try again?


Broken link

Factory restore link is broken and leads to a 404

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 13376c1b-df70-83de-8e6a-8ddc940774b5
Version Independent ID: 6a2531ee-ac88-ee83-b858-1928d6cb4c65
Content: Use the Microsoft Teams Rooms recovery tool - Microsoft Teams
Content Source: Teams/rooms/recovery-tool.md
Service: msteams
GitHub Login: @LanaChin
Microsoft Alias: v-lanac

@cvoigt  Thank you for submitting feedback and contributing to the docs. We are currently investigating this.

Thanks @cvoigt  for bringing this to our attention.  @dariomws306, I've merged your updates. Thanks!


Switch to fast RMS/LN Norm

Switch RMSNorm to nn.RMSNorm to get fast rms
Switch LayerNorm to nn.LayerNorm to get fast LN
Update a few more models to use SDPA
Clean up old lora to reduce some surface area and point to MLX LM for more features.

NB tests won't clear until 0.8 is out, but they clear locally for me with latest MLX

@awni  I noticed something strange, this started after this PR. Generation ois considerably slower when used with adapters file:
mlx 0.8 + mlx_lm 0.4 --> Prompt: 140.416 tokens-per-sec / Generation: 24.049 tokens-per-sec
mlx 0.8 + mlx_examples https://github.com/ml-explore/mlx-examples/commit/5a52899405ee911ce07ca3132e781ce149acd6b5 --> Prompt: 106.642 tokens-per-sec / Generation: 13.586 tokens-per-sec
I use python -m mlx_lm.generate --model mistralai/Mistral-7B-v0.1 --max-tokens 300 --prompt "[INST] Discuss the pros and cons of genetically modified crops and their impact on the food industry and agriculture. [/INST]" --adapter-file ./adapters.npz

That's odd and unexpected. Thanks for flagging, we'll take a look!

Maybe we are inadvertently upcasting now when you include the adapters which would slow a lot of stuff down 🤔


Type error: use Omit or Pick with RecipeVariants

Describe the bug
I export type use RecipeVariants, other file use Omit or Pick with this type. webstorm or vscode get type error
Link to reproduction
RecipeVariants type
https://github.com/huijiewei/agile-ui/blob/main/packages/react/src/button/Button.css.ts
use Omit or Pick
https://github.com/huijiewei/agile-ui/blob/main/packages/react/src/button/ButtonGroup.tsx
Some info
After my test， if ts compilerOptions strict set true, type is error
more detail config is strictNullChecks
System Info
 System:
    OS: macOS 12.0.1
    CPU: (6) x64 Intel(R) Core(TM) i5-9600K CPU @ 3.70GHz
    Memory: 294.38 MB / 16.00 GB
    Shell: 5.8 - /usr/local/bin/zsh
  Binaries:
    Node: 17.2.0 - /usr/local/bin/node
    npm: 8.1.4 - /usr/local/bin/npm
  Browsers:
    Chrome: 96.0.4664.93
    Safari: 15.1
  npmPackages:
    esbuild: ^0.14.3 => 0.14.3

https://codesandbox.io/s/vademo-z4ss9?file=/src/components/ButtonGroup.tsx
I use codesandbox write a demo . that is ok.

After my test， if ts compilerOptions strict set true, type is error

RecipeVariants includes undefined, so keyof RecipeVariants returns never. To use Omit, you have to ignore undefined, for example using NonNullable:
type Variants = RecipeVariants<typeof recipe>;
type Props = Omit<React.ComponentProps<'button'>, keyof NonNullable<Variants>> & Variants;

Closing as @graup's response is correct.

hi,
better to have this type imo :
type Variants = NonNullable<RecipeVariants<typeof button>>;

Why does RecipeVariants include undefined? We ended up adding NonNullable to all of our usages of RecipeVariants. I feel RecipeVariants shouldn't include undefined in the first place. Or is there a good reason for it?

Why does RecipeVariants include undefined? We ended up adding NonNullable to all of our usages of RecipeVariants. I feel RecipeVariants shouldn't include undefined in the first place. Or is there a good reason for it?

Bumping this question, I'm curious about this too!

Why does RecipeVariants include undefined? We ended up adding NonNullable to all of our usages of RecipeVariants. I feel RecipeVariants shouldn't include undefined in the first place. Or is there a good reason for it?

Bumping @emlai's question, I'm curious about this too!

This is because RecipeVariants is just getting the type of the first parameter of the input recipe function, which is optional. It's optional because you may want to use only the default variants, in which case you don't need to pass in anything.
I agree that it probably makes more sense to include the NonNullable within RecipeVariants as it's likely most users want to access the properties and don't actually care about the optionality of the parameter.

Yeah!  These are the workarounds that I've seen:
type ButtonSize = NonNullable<
  NonNullable<RecipeVariants<typeof buttonRecipe>>['size']
>;

// Resolves to:
//   type ButtonSize = "mini" | "small" | "large"

or
type ButtonSize = Required<
  NonNullable<RecipeVariants<typeof buttonRecipe>>
>['size'];

Neither are very easy to read/understand and they're so long prettier is wrapping them 😬.  It would be nice if either of these was abstracted into a type utility!  I'm imagining something like this:
const ButtonSize = RecipeVariant<typeof buttonRecipe, "size">;


Warning: Unexpected input(s) 'repository', valid inputs are ['body', 'body_path', 'name', 'tag_name', 'draft', 'prerelease', 'files']

when I use like this
- name: release
        uses: softprops/action-gh-release@v1
        if: startsWith(github.ref, 'refs/tags/')
        with:
          repository: guanpengchn/aaa
          files: "dist/**"

got a warning and still use the old repo
Warning: Unexpected input(s) 'repository', valid inputs are ['body', 'body_path', 'name', 'tag_name', 'draft', 'prerelease', 'files']

@guanpengchn That PR has not been released yet. If you want to test it, you can change the uses block to read: uses: softprops/action-gh-release@master

@guanpengchn That PR has not been released yet. If you want to test it, you can change the uses block to read: uses: softprops/action-gh-release@master

My bad on that. I'll try up update the release version this weekend

My bad on that. I'll try up update the release version this weekend

@AustinShalit @softprops Thank you very much~ What a good weekend

@AustinShalit @softprops Thank you very much~ What a good weekend

when I use softprops/action-gh-release@master, got an error API rate limit exceeded for user ID 13995641.
The detail message is
👩🏭 Creating new GitHub release for tag v0.0.8...
⚠ GitHub release failed with status: 422, retrying...
👩🏭 Creating new GitHub release for tag v0.0.8...
⚠ GitHub release failed with status: 422, retrying...
👩🏭 Creating new GitHub release for tag v0.0.8...
⚠ GitHub release failed with status: 422, retrying...

...

⚠ Unexpected error fetching GitHub release for tag refs/tags/v0.0.8: HttpError: API rate limit exceeded for user ID 13995641.
Error: API rate limit exceeded for user ID 13995641.

this has since been released


Service account support

Currently, the operator API can only be used by authenticating with the credentials that they will get through an interactive oauth2 flow (chainloop auth login), these credentials, by default, last 24 hours and hence are not suitable for long-lasting automation.
To do that, we might need to offer service accounts (potentially attached to organizations). A service account will provide a long-lasting token (with optional expiration time), that can be revoked at any time.
We've a similar mechanism already implemented for workflow robot-accounts. We should think how/if these are related.

Duplicate of #453


CUDA out of memory

Hi, appreciate your code.
I am trying to fine-tune on the contact task with your script
bash run_main.sh \
      --model /root/cmh/KeAP/pretrained_model/ \
      --output_file output/contact-KeAP20 \
      --task_name contact \
      --do_train True \
      --epoch 5 \
      --optimizer AdamW \
      --per_device_batch_size 1 \
      --gradient_accumulation_steps 8 \
      --eval_step 50 \
      --eval_batchsize 1 \
      --warmup_ratio 0.08 \
      --learning_rate 3e-5 \
      --seed 3 \
      --frozen_bert False

but the memory is not enough, my GPU is a 3090 with 24 GB memory.
Could you please tell me how what are your GPUs, or is there anything wrong on my code?

Thanks!


Add SPARK_HOME env. allow playbook to set extra spark env vars if needed

published as v2.0.1 to the galaxy


Auto Lombok @UtilityClass

For a class that is a utility class https://projectlombok.org/features/experimental/UtilityClass automatically transform the class into a @UtilityClass

Could you please assign it to me? I would attempt it in coming weeks...


Add backticks around readonly in Interfaces.md

Throughout the whole document, readonly is always styled as an inline code, except in this occurrence.
This change adds the backticks around it so it follows the same pattern.

I think this is probably the right call (it does refer to readonly syntax in the code sample above) thanks folks!


Vendor in containers/storage v1.12.16

This will allow podman to run with a single rootless UID Map and ignore
chown errors.  Potential use case for HPC Customers.
Other optimizations and bugfixes in containers/storage.
Signed-off-by: Daniel J Walsh<EMAIL_ADDRESS>

LGTM once tests go green

I can reproduce locally and will take a look
[+0400s] TYPE            TOTAL   ACTIVE   SIZE    RECLAIMABLE
[+0400s] Images          8       2        111MB   109MB (98%)
[+0400s] Containers      2       0        0B      0B (0%)
[+0400s] Local Volumes   1       1        0B      0B (0%)
...
[+0400s]   Expected
[+0400s]       <string>: 8
[+0400s]   to equal
[+0400s]       <string>: 9
[+0400s]
[+0400s]   /var/tmp/go/src/github.com/containers/libpod/test/e2e/system_df_test.go:59

/var/tmp/go/src/github.com/containers/libpod/test/e2e/system_df_test.go:59 is also failing on master. I'll try to fix it there so you can rebase here.

/retest

/test all


Support Oracle NOT NULL constraint in declaration

Support Oracle declaration NOT NULL constraint
https://docs.oracle.com/en/database/oracle/oracle-database/19/lnpls/scalar-variable-declaration.html#GUID-03124315-0E1E-4154-8EBE-12034CA6AD55

Codecov Report
Attention: 1 lines in your changes are missing coverage. Please review.

Comparison is base (e67b2f4) 58.74% compared to head (e56a3fd) 58.74%.

Additional details and impacted files

@@            Coverage Diff            @@
##             master    #5733   +/-   ##
=========================================
  Coverage     58.74%   58.74%
- Complexity    27801    27802    +1
=========================================
  Files          1333     1333
  Lines        127716   127725    +9
  Branches      24066    24069    +3
=========================================
+ Hits          75024    75036   +12
+ Misses        43357    43347   -10
- Partials       9335     9342    +7

Files
Coverage Δ

...n/java/com/alibaba/druid/sql/ast/SQLParameter.java
74.66% <100.00%> (+1.05%)
:arrow_up:

...l/dialect/oracle/parser/OracleStatementParser.java
79.73% <100.00%> (+0.03%)
:arrow_up:

...alibaba/druid/sql/visitor/SQLASTOutputVisitor.java
68.86% <50.00%> (-0.01%)
:arrow_down:

... and 9 files with indirect coverage changes

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e67b2f4...e56a3fd. Read the comment docs.


Add more Language code to label mappings

This is related to #296. Feel free to add any suggestions or requests. I hope I covered all of the used languages of this era.

Please disregard this one since it contains some commits from a failed rebase.


Sizing carousel view to full width without weird margins

For example
In Iphone emulator 2436x1125 i need to specify a height of ~250px
In Android device 782x480 i need to specify a height of ~215px
Something weird in iphone emulator for example, with 1125px width, for the image to fully cover horizontally no way the carousel should have less than ~500px height while testing it needs ~250px height.

Did you try to change aspect of image?
Aspect.Fill etc

https://docs.microsoft.com/en-us/dotnet/api/xamarin.forms.aspect?view=xamarin-forms
I hope, it will help you.
Point is that isn't CardsView issue.. this is something with image settings

Contact me pls after trying this way


Add parameters to improve usage.

Closing this as stale. No updates in a more than a year. Please re-open after rebase if still applicable.


In 'controller': ConfigTypeError raised while composing config:

I'm trying to train from scratch, but when I finally get to step #### 4. Train an ACT controller to follow spheres, an error is reported:

In 'controller': ConfigTypeError raised while composing config.
Cannot merge DictConfig with ListConfig
    full_key.
    object_type=dict

I'm guessing this error is probably due to the definition of env.tasks. But no matter how I change the definition of env.tasks (env.tasks=[take_lid_off_saucepan] or env.tasks=['take_lid_off_saucepan'] or env.tasks= "[take_lid_off_saucepan]") will give this error.
Do you have any suggestions on how to fix this? Thanks!

@albzni can you post the full command you are trying to run?

@albzni can you post the full command you are trying to run?

Can you run with HYDRA_FULL_ERROR=1 so we can see the full stack trace?

Sure! The full error stack message:
Traceback (most recent call last):
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/config_loader_impl.py", line 542, in _compose_config_from_defaults_list
    cfg.merge_with(loaded.config)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 492, in merge_with
    self._format_and_raise(key=None, value=None, cause=e)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/base.py", line 231, in _format_and_raise
    format_and_raise(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/_utils.py", line 899, in format_and_raise
    _raise(ex, cause)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/_utils.py", line 797, in _raise
    raise ex.with_traceback(sys.exc_info()[2])  # set env var OC_CAUSE=1 for full trace
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 490, in merge_with
    self._merge_with(*others)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 514, in _merge_with
    BaseContainer._map_merge(self, other)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 399, in _map_merge
    dest_node._merge_with(src_node)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 514, in _merge_with
    BaseContainer._map_merge(self, other)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 399, in _map_merge
    dest_node._merge_with(src_node)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 518, in _merge_with
    raise TypeError("Cannot merge DictConfig with ListConfig")
omegaconf.errors.ConfigTypeError: Cannot merge DictConfig with ListConfig
    full_key:
    object_type=dict

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data3/czx/genima/controller/train_act.py", line 296, in <module>
    main()
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/main.py", line 94, in decorated_main
    _run_hydra(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/utils.py", line 394, in _run_hydra
    _run_app(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/utils.py", line 457, in _run_app
    run_and_report(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/utils.py", line 223, in run_and_report
    raise ex
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/utils.py", line 220, in run_and_report
    return func()
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/utils.py", line 458, in <lambda>
    lambda: hydra.run(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/hydra.py", line 105, in run
    cfg = self.compose_config(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/hydra.py", line 594, in compose_config
    cfg = self.config_loader.load_configuration(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/config_loader_impl.py", line 142, in load_configuration
    return self._load_configuration_impl(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/config_loader_impl.py", line 263, in _load_configuration_impl
    cfg = self._compose_config_from_defaults_list(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/config_loader_impl.py", line 544, in _compose_config_from_defaults_list
    raise ConfigCompositionException(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/hydra/_internal/config_loader_impl.py", line 542, in _compose_config_from_defaults_list
    cfg.merge_with(loaded.config)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 492, in merge_with
    self._format_and_raise(key=None, value=None, cause=e)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/base.py", line 231, in _format_and_raise
    format_and_raise(
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/_utils.py", line 899, in format_and_raise
    _raise(ex, cause)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/_utils.py", line 797, in _raise
    raise ex.with_traceback(sys.exc_info()[2])  # set env var OC_CAUSE=1 for full trace
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 490, in merge_with
    self._merge_with(*others)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 514, in _merge_with
    BaseContainer._map_merge(self, other)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 399, in _map_merge
    dest_node._merge_with(src_node)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 514, in _merge_with
    BaseContainer._map_merge(self, other)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 399, in _map_merge
    dest_node._merge_with(src_node)
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/omegaconf/basecontainer.py", line 518, in _merge_with
    raise TypeError("Cannot merge DictConfig with ListConfig")
hydra.errors.ConfigCompositionException: In 'controller': ConfigTypeError raised while composing config:
Cannot merge DictConfig with ListConfig
    full_key:
    object_type=dict

Does it work if you modify it in controller.yaml instead of overriding it in the command? Sorry I have no Linux means to debug this at the moment. Appreciate the patience

~Does it work if you modify it in controller.yaml instead of overriding it in the command? Sorry I have no Linux means to debug this at the moment. Appreciate the patience~ I think we have found a fix, will push very shortly now

Great! Thank you for your patience in replying😄

Can you pull and try again? Replace .tasks with .train_tasks

Can you pull and try again? Replace .tasks with .train_tasks. There is a config name conflict with the underlying robobase hydra config files

Thank you! This one worked! But when I was able to get it running I ran into another problem:
[2024-07-17 12:21:41,627][root][WARNING] - Multicam fusion is enabled but view_fusion_model is not set!
[2024-07-17 12:21:42,158][root][INFO] -          saving to disk: /tmp/tmp0yh4hpzh
[2024-07-17 12:21:42,160][root][INFO] - Creating a EpochReplayBuffer replay memory with the following parameters:
[2024-07-17 12:21:42,160][root][INFO] -          frame_stack: 1
[2024-07-17 12:21:42,161][root][INFO] -          replay_capacity: 1000000
[2024-07-17 12:21:42,161][root][INFO] -          batch_size: 8
[2024-07-17 12:21:42,161][root][INFO] -          nstep: 3
[2024-07-17 12:21:42,161][root][INFO] -          gamma: 0.990000
Action mean: [-0.1170458   0.01044554  0.12544061 -2.20029259 -0.04368392  2.01885772
  1.71965766  0.5       ]
Action std: [0.65933877 0.45918962 0.68142641 0.44278744 0.58593202 0.48843095
 0.78792626 0.16666667]
Saved to {self.action_stats_path}/action_stats.json
Proprio mean: [ 0.5        -0.1170458   0.01044554  0.12544061 -2.20029259 -0.04368392
  2.01885772  1.71965766]
Proprio std: [0.16666667 0.65933877 0.45918962 0.68142641 0.44278744 0.58593202
 0.48843095 0.78792626]
Saved to {self.proprio_stats_path}/proprio_stats.json
Error executing job with overrides: ['env=rlbench', 'env.dataset_root=/data3/share/genima_data/rendered/train_data_rnd_bg', 'work_dir=/data3/czx/genima/controller', 'demos=25', 'env.train_tasks=[take_shoes_out_of_box]', 'num_train_epochs=1000', 'action_sequence=20', 'batch_size=8', 'wandb.use=false']
Traceback (most recent call last):
  File "/data3/czx/genima/controller/train_act.py", line 292, in main
    workspace.train()
  File "/data3/czx/genima/controller/train_act.py", line 259, in train
    self._load_demos()
  File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/workspace.py", line 489, in _load_demos
    self.env_factory.load_demos_into_replay(self.cfg, self.replay_buffer)
  File "/data3/czx/genima/controller/env/rlbench.py", line 351, in load_demos_into_replay
    add_demo_to_replay_buffer(demo_env, buffer)
  File "/data3/czx/genima/controller/env/rlbench_utils.py", line 248, in add_demo_to_replay_buffer
    replay_buffer.add(act, rew, term, trunc, **obs_and_info)
TypeError: UniformReplayBuffer.add() missing 1 required positional argument: 'truncated'

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.

(I've collected data on the "take_shoes_out_of_box" task, which is not in your paper, to see how well genima works on this task.^_^
The RLBench environment is able to render it successfully and my run command is:
python train_act.py \
     env=rlbench \
     env.dataset_root=/data3/share/genima_data/rendered/train_data_rnd_bg \
     work_dir=/data3/czx/genima/controller \
     demos=25 \
     env.train_tasks=[take_shoes_out_of_box] \
     num_train_epochs=1000 \
     action_sequence=20 \
     batch_size=8 \
     wandb.use=false

I tried to solve this bug by myself, but because I am not familiar with the overall code structure, change a place will appear more bugs, so again to seek your help, thank you for your patience！🙏

@albzni, can you replace that line in rlbench_utils.py with
replay_buffer.add(obs, act, rew, term, trunc, **obs_and_info)?
And thanks for your patience! We unfortunately lost access to all our resources and compute before we could properly test things 😢. But I think you are getting close. After fixing train_act.py, everything should work 🤞

@albzni, can you replace that line in rlbench_utils.py with replay_buffer.add(obs, act, rew, term, trunc, **obs_and_info)?
And thanks for your patience! We unfortunately lost access to all our resources and compute before we could properly test things 😢. But I think you are getting close. After fixing train_act.py, everything should work 🤞

Thank you for your reply! This solution did solve the problem I asked about above (although I still encountered a small error later on, but I've found the cause and solved it myself based on your suggestion (^_^)v ).
Now I can proceed with training the model without any problems, thanks again for your help!🙏

@albzni, that's great!
Can you tell us what the other problem was? So we can fix it if anything is wrong. Thanks!

@MohitShridhar Sure! I encountered the following 3 main errors:
Traceback (most recent call last):
File "/data3/czx/genima/controller/train_act.py", line 292, in main
workspace.train()
File "/data3/czx/genima/controller/train_act.py", line 259, in train
self._load_demos()
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/workspace.py", line 489, in _load_demos
self.env_factory.load_demos_into_replay(self.cfg, self.replay_buffer)
File "/data3/czx/genima/controller/env/rlbench.py", line 351, in load_demos_into_replay
add_demo_to_replay_buffer(demo_env, buffer)
File "/data3/czx/genima/controller/env/rlbench_utils.py", line 247, in add_demo_to_replay_buffer
replay_buffer.add(obs, act, rew, term, trunc, **obs_and_info)
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/replay_buffer/uniform_replay_buffer.py", line 416, in add
self._check_add_types(transition, self._storage_signature)
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/replay_buffer/uniform_replay_buffer.py", line 533, in _check_add_types
raise ValueError(
ValueError: arg front_rgb has shape (1, 3, 256, 256), expected (3, 256, 256)

I add
for key, value in obs.items():
            if isinstance(value, np.ndarray) and value.shape[0] == 1:
                obs[key] = value.squeeze(0)

before replay_buffer.add(obs, act, rew, term, trunc, **obs_and_info) to fix this error.
Traceback (most recent call last):
File "/data3/czx/genima/controller/train_act.py", line 292, in main
workspace.train()
File "/data3/czx/genima/controller/train_act.py", line 259, in train
self._load_demos()
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/workspace.py", line 489, in _load_demos
self.env_factory.load_demos_into_replay(self.cfg, self.replay_buffer)
File "/data3/czx/genima/controller/env/rlbench.py", line 351, in load_demos_into_replay
add_demo_to_replay_buffer(demo_env, buffer)
File "/data3/czx/genima/controller/env/rlbench_utils.py", line 262, in add_demo_to_replay_buffer
replay_buffer.add_final(**final_obs)
TypeError: UniformReplayBuffer.add_final() got an unexpected keyword argument 'front_rgb'

I replaced replay_buffer.add_final(**final_obs) with replay_buffer.add_final(final_obs) to fix this error.
Unexpected error in training: operands could not be broadcast together with shapes (2,) (3,)
[2024-07-17 16:51:39,481][root][ERROR] - Traceback (most recent call last):
File "/data3/czx/genima/controller/train_act.py", line 218, in _train
self.agent.update(
File "/data3/czx/genima/controller/method/genima_act.py", line 365, in update
batch = next(replay_iter)
File "/data3/czx/genima/controller/utils/dataloader.py", line 93, in next
return self.sample(batch_size=len(batch_indices), indices=batch_indices)
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/replay_buffer/uniform_replay_buffer.py", line 843, in sample
samples = [self.sample_single(indices[i]) for i in range(batch_size)]
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/replay_buffer/uniform_replay_buffer.py", line 843, in <listcomp>
samples = [self.sample_single(indices[i]) for i in range(batch_size)]
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/replay_buffer/uniform_replay_buffer.py", line 829, in sample_single
return self._sample_non_sequential(global_index)
File "/home/czx/anaconda3/envs/genima_env/lib/python3.10/site-packages/robobase/replay_buffer/uniform_replay_buffer.py", line 794, in _sample_non_sequential
episode[REWARD][idx]
ValueError: operands could not be broadcast together with shapes (2,) (3,)

I changed the relevant lines in uniform_replay_buffer.py to：
    next_idx = min(next_idx, len(episode[TERMINAL]))
    discount_slice_len = next_idx - idx

    ###2024.7.17
    reward_slice = episode[REWARD][idx:next_idx]
    discount_slice = self._cumulative_discount_vector[:discount_slice_len]

    # Adjust the shape if necessary
    if reward_slice.shape != discount_slice.shape:
        min_len = min(reward_slice.shape[0], discount_slice.shape[0])
        reward_slice = reward_slice[:min_len]
        discount_slice = discount_slice[:min_len]
    ###

    replay_sample.update(
        {
            REWARD: np.sum(reward_slice * discount_slice),
            TERMINAL: episode[TERMINAL][next_idx - 1],
            TRUNCATED: episode[TRUNCATED][next_idx - 1],
            INDICES: global_index,
            DISCOUNT: self._gamma**discount_slice_len,  # effective discount
        }
    )

Notably, the above solutions may not always be right, but I'm now able to train successfully. 😄

By the way, if you find any problems with my solutions above after checking them out (e.g. negatively affecting the training results), please let me know, thank you very much! 🙏🙏

@albzni Thanks for the detailed information. I think the first two we will push those as fixes. For the third one, if you remove the lines you added (i.e., keep the replay buffer as is) and in controller.yaml, add:
replay:
    nstep: 1

Does that solve the issue?

@albzni Thanks for the detailed information. I think the first two we will push those as fixes. For the third one, if you remove the lines you added (i.e., keep the replay buffer as is) and in controller.yaml, add:
replay:
    nstep: 1

Does that solve the issue?

It works! Thank you so much 😄

Great! Thanks for debugging with us!


Refactor build system to support modrinth tweaks

I'm opening this PR early in an unfinished state to give an idea of what I'm working on for integrating the modrinth tweaks into the main branch.
At this stage I've stubbed out a gradle multi-project build as follows:
> Task :projects

------------------------------------------------------------
Root project 'freecam'
------------------------------------------------------------

Root project 'freecam'
+--- Project ':common'
+--- Project ':fabric'
+--- Project ':fabric-modrinth'
+--- Project ':forge'
+--- Project ':forge-modrinth'
\--- Project ':modrinth'

TODO:

[x] Refactor allprojects and subprojects usage into "convention" plugins
[x] Refactor repeated config into convention plugins
[x] Add additional :modrinth project which uses the same sources as :common
[x] Add -modrinth varients of :forge and :fabric projects, using :modrinth instead of :common
[x] Inject additional properties in processResources to allow "name" to be "Freecam (Modrinth Edition)"
[x] Ensure jars are named correctly (e.g. freecam-fabric.jar) (see #122)
[x] Implement a JSON overloading task to add/replace lang file entries
[x] Generate a "BuildConfig" class which contains static-final constants such as CHEATS_RESTRICTED and TOOLTIP_COUNTS
[x] Merge the actual changes from the modrinth branch
[ ] Final cleanup of git history (after code review & other PRs being merged)

Preprocessing

Use JCP or RM's equivalent to pre-process the common/modrinth sources EDIT: I've done a POC using JCP, which reminded me how clunky java preprocessing can be. I think generating a config class would be simpler:

Dependency injection - :common & :modrinth inject different implementations of some interface
Source code generation - a class is rendered using a gradle task
Self-targeting mixins - :modrinth adds mixins that hook into :common's code

Personally I think preprocessing is the simplest, especially for the case where @ConfigEntry.Tooltip annotations need different values. It would mean additional noise where changes are required, however I don't think there will need to be a lot of differences. EDIT: annotation values can be set to static-final fields, so code-gen could still work here...
Lang files would need to be handled separately. I'm imagining a gradle copy task that can be used within processResources. The task would parse the base lang file as json, then parse an override file as well. Merge the changes and write the result to the build outputs. EDIT: this is done.

Note on Convention Plugins
Convention plugins are small gradle plugins located in buildSrc that each describe a "trait" of our config. They can be used modularly throughout the actual config as a more flexible alternative to allprojects and subprojects. The official guide, and sample projects are worth a quick look if you're unfamiliar. After these changes most of the shared configuration logic lives under buildSrc.

This is coming along now. Just need to merge the modrinth branch's mixin patches, expand more properties in mods.toml & fabric.mod.json, cleanup git history, rebase once #122 is merged, test, polish & review.
There's two main systems in play to handle the modrinth differences:
JSON overloading
I've introduced a small gradle plugin which hooks into processResources in order to modify assets

@hashalite This is feature complete, somewhat tested and ready for review. :tada:
There are some related commits that could be squashed further before merging, and others that would become redundant if other PRs get merged. I've left the history somewhat granular to hopefully aid review.
If anything looks complex I'm happy to explain and/or refactor.

After a conversation with @wagyourtail there's a few improvements that can be made to this PR:

By switching from autoconfig to cloth-config proper we avoid needing to inject translation keys into the lang files; each key could have a .modrinth variant all in one file.

This lessens the need for code-gen & JSON merging.
This will also give better control of the config GUI & stored config values.
This could be done in a separate PR.

ServiceLoader can be used to inject different implementations of Behaviour

This removes the need for any code generation.

(A bit more radical) porting from architectury to unimined may enable a simpler project layout.

I wasn't aware this existed when writing #118
unimined is less prescriptive, and allows more control over using sourceSets vs projects
unimined can still use archi-api, however I've been thinking of dropping this dependency anyway...
Potential downsides

Less documentation (not that architectury has much)
No migrateMappings task (not that manual mapping updates are difficult)
No ExpectPlatform API, would just use ServiceLoaders.

Closed in favor of #132


Add faster test262 test target

add test262-fast.conf with lengthy tests disabled
add test262-fast corresponding target
make valgrind use test262-fast
output test_index instead of test_count in show_progess()

@chqrlie LGTM! If you push the branch to this repo, you can trigger a Valgrind buiild for the branch before it gets merged.


Corrupting it's perms file + failing negative perm

Two major issues for us with v1.22.4. Both issues are good in 1.22.3. Offline mode.

it's corrupting permissions.yml. Repeatedly, and pretty fast. Excerpt below. Syntax is ok, it loads, but it's logically wrong. It's putting players inside a player block, and making huge lists of duplicates. My file is 170k when healthy, and dupes data up to 600k in a few hours.

A negative perm "-herochat.speak.global" or "-herochat.speak.*" is not respected for our guest group. Debug mode says the perm is true, and so they can speak. It's possible this is caused by the perm file corruption

-- Excerpt --------
 cfc45270-87ad-3a50-867e-f561c716a34b: &id4298
   group:
   - guest
   options:
     name: VEgettaGaymer
 101590a8-afdb-3d35-9bea-cc61553be6de:
   silvercatz: *id1709
   invot: *id1710
   Light_BRing3R: *id1718
   abec9cd9-257b-353d-8d3a-c101f92f3ec5: *id1719
   PowerMiner: *id1722
   PinkSnapper: *id1723
   Profesionalskit: *id1724
   Ulerx: *id1725
   Tofuman89: *id1726
   Lumine1: *id2027
   russ_al: *id2028
   Lgoddgreat: *id2029
   tobythegreat: *id2030
   profjimbob: *id2031
   TobeyPorK: *id2032
   e2f9ff26-d463-3c41-b3f5-195125f2053f: *id2033
   36b65b90-4fa5-3184-81a7-30974d36d277: *id2044
   c8eac922-8ffc-3602-9da6-da62485720cb: *id2045
   aa17bf97-2259-32d4-a9ab-e022d5a535ff: *id2046
   58ffd0b4-b900-3a07-90b0-192dd0fb66ed: *id2050
   6497b296-06d9-3df5-8ba2-bebe49ec826a: *id2051
   9ea08e78-6a3b-3459-b905-937e8b05d0d7: *id2052
   acf15a73-7423-34d2-9baa-6df386b7145f: *id2053
   9e255bcf-479a-3eb9-99c3-90e4fcbd35fe: *id2054
   2259e385-f5be-3768-adfe-d30ae7b3e142: *id2055
   49ca95de-cc6d-3e26-a724-66920be14eac: *id2056
... snip...
   barixs:
     group:
     - guest
     options:
       name: barixs
   CREEPER1:
     group:
     - guest
     options:
       name: CREEPER1
 02aa1302-ced5-310d-a47f-a89d74d16553:
   options:
     name: pianoaaakkk

Because this is an issue that has not been reported by anyone else and is attached to how Bukkit handles configurations, I think this is an issue you're going to have to live with unless it returns for Sponge PEX.


flow support?

Any plans to add flow support?

this would be awesome!

i believe you can do passthrough from deoplete-flow by adding both deoplete and deoplete-flow, and setting up deoplete as an nvim-completion-manager source

i believe you can do passthrough from deoplete-flow by adding both deoplete and deoplete-flow, and setting up deoplete as an nvim-completion-manager source

I'm actually trying nvim-completion-manager, because I had too many issues with deoplete.

I'm actually trying nvim-completion-manager, because I had too many issues with deoplete.

Interesting.

@Shougo Just to be clear, maybe deoplete itself is not bad but the other completions are the problem. I had lots of problems with deoplete-tern for example.
While nvim-completion-manager & completor.vim they just work. So I'm trying all the options to see which one will work for me

Ah, OK.
I recommend for you to use LSP typescript client.
It also supports javascript.

@Shougo that lsp server doesn't support flow. Actually, it shows errors everywhere cause flow is not a valid syntax

LSP flow client is needed...

Closing
Further discussions should be posted at https://github.com/roxma/ncm-flow/issues/1

Actually Facebook is developing a Flow language server.


Overhaul

This is a major and breaking change which completely overhauls how the test flow is represented in the AST and how it is optimized.
When approved, it will be released as v1.0.0 which will prevent the changes from affecting the existing versions of OrigenTesters and DocHelpers. Both will require updates to work with ATP v1.
The background to why these changes are being made is covered in this comment and discussion thread: https://github.com/Origen-SDK/origen_testers/pull/59#issuecomment-333828537
Here is a summary of what has changed:

The raw (un-processed) AST used to be stored with conditions wrapped around each test individually. e.g.

if_flag :blah do
  test :test1
  test :test2
end

flow.ast   # => s(:flow,
           #       ...
           #      s(:if_flag, "blah",
           #        s(:test,
           #          s(:object, "test1"))),
           #      s(:if_flag, "blah",
           #        s(:test,
           #          s(:object, "test2"))),

However, now it is stored to match exactly how the user entered it:
if_flag :blah do
  test :test1
  test :test2
end

flow.ast   # => s(:flow,
           #       ...
           #      s(:if_flag, "blah",
           #        s(:test,
           #          s(:object, "test1")),
           #        s(:test,
           #          s(:object, "test2"))),

Previously ATP had its own API for defining flows which was slightly different to that used by OrigenTesters, meaning that OrigenTesters had to have a translation layer between its user-facing API and ATP. The ATP API has been change to align exactly to that provided by the user by OrigenTesters, and the AST nodes now correspond exactly to the operation names in the API.
All AST processing that was previously done in OrigenTesters (for V93K) has now been moved in here. Want to establish the convention going foward that all AST transformation will be handled by ATP. This makes it easier to test and to make sure that any future changes to the AST are handled correctly by the processors.
Mutiple AST views are now supported which perform different optimizations to make downstream rendering for Teradyne vs Advantest easier.
Test coverage has been improved significantly and CI and code coverage reporting has been added.

Generally, the source diff is no good for reviewing a major change like this one.
The main thing to be reviewed here is whether you agree with the principle of the changes and to pose any questions/risks that might spring to mind.
The real diff review will be done in the corresponding update to OrigenTesters where it can be verified that what this produces matches we previously had.

thx @ginty!


For mode:Simple also its ignoring SAN from destination rule, Not validating

Connected to nemnationwide.dummyiib.com (<IP_ADDRESS>) port 443 (#0)
ALPN, offering h2
ALPN, offering http/1.1
successfully set certificate verify locations:
CAfile: ca.crt
CApath: none
TLSv1.3 (OUT), TLS handshake, Client hello (1):
TLSv1.3 (IN), TLS handshake, Server hello (2):
TLSv1.3 (IN), TLS handshake, [no content] (0):
TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
TLSv1.3 (IN), TLS handshake, Certificate (11):
TLSv1.3 (IN), TLS handshake, CERT verify (15):
TLSv1.3 (IN), TLS handshake, Finished (20):
TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
TLSv1.3 (OUT), TLS handshake, [no content] (0):
TLSv1.3 (OUT), TLS handshake, Finished (20):
SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
ALPN, server accepted to use h2
Server certificate:
subject: O=secureapi; CN=secure.com
start date: Mar 18 10:07:45 2021 GMT
expire date: Jun 16 10:07:45 2021 GMT
subjectAltName: host "nemnationwide.dummyiib.com" matched cert's "nemnationwide.dummyiib.com"
issuer: O=secureapi; CN=secure.com
SSL certificate verify ok.
Using HTTP2, server supports multi-use
Connection state changed (HTTP/2 confirmed)
Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
TLSv1.3 (OUT), TLS app data, [no content] (0):
TLSv1.3 (OUT), TLS app data, [no content] (0):
TLSv1.3 (OUT), TLS app data, [no content] (0):
Using Stream ID: 1 (easy handle 0x55b2d02a94c0)
TLSv1.3 (OUT), TLS app data, [no content] (0):
GET /creditcard-pendingtransactions/v1/CC00000000333/transactions?fromDate=2020-08-01 HTTP/2
Host: nemnationwide.dummyiib.com
User-Agent: curl/7.61.1
Accept: /
TLSv1.3 (IN), TLS handshake, [no content] (0):
TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
TLSv1.3 (IN), TLS app data, [no content] (0):
Connection state changed (MAX_CONCURRENT_STREAMS ==<PHONE_NUMBER>)!
TLSv1.3 (OUT), TLS app data, [no content] (0):
TLSv1.3 (IN), TLS app data, [no content] (0):
< HTTP/2 200
< service-version: v1
< content-type: application/json;charset=utf-8
< server: istio-envoy
< date: Tue, 13 Apr 2021 06:20:43 GMT
< content-length: 184
< x-envoy-upstream-service-time: 151
<
Connection #0 to host nemnationwide.dummyiib.com left intact
`

apiVersion: networking.istio.io/v1beta1
kind: Gateway
metadata:
name: secure-gateway1
spec:
selector:
istio: ingressgateway
servers:
port:
name: https
number: 443
protocol: HTTPS
tls:
cipherSuites: [ECDHE-RSA-AES256-GCM-SHA384]
credentialName: secure-credential
minProtocolVersion: TLSV1_3
mode: SIMPLE
subjectAltNames:

company.platform.server
hosts:
nemnationwide.dummyiib.com

X509v3 Extended Key Usage:
TLS Web Server Authentication
X509v3 Basic Constraints: critical
CA:FALSE
X509v3 Subject Alternative Name:
DNS:httpapi.secure.com, DNS:nemnationwide.dummyiib.com

It should fail but getting success. That means ignoring Destination Rule for mode:Simple also in Ingress Gateway

@ramaraochavali If you can contribute here will be helpful.
Thanks

When i am deleting the gateway and creating again with 'subjectAltNames:

company.platform.server', Its working fine.

but if i modify gateway yaml it does't work.
Does it cache the entries ?

2


update packaging

update pyscaffold version, update workflows for new packaging procedures.
try fully migrating to pyproject.toml (but ... I do like development installations)

pyscaffold version not updated but the workflows are.

don't migrate to rst files
do include docs this time around during upgrade with pyscaffold
different homepage on docs than the readme


SQL injections warning not suppressed

This change fixes the SQL Injection Warning that is triggered from the Security Items page; I have tested this using IAF Example (with and without the change) however I'm not sure if adding a unit-test is worth the effort?
NB: The bug only applies to 7.8 and earlier. It does not apply to 7.9, as the code for the Security Items has changed and no longer triggers this warning.

The issue states: 'On Localhost I don't see the warning, but in DEV/TEST it's present.' It might be good to check the cause of that.

This could simply be caused by someone having looked at the Security Items page on DEV/TEST before. As far as I could see in my local tests, the warning did not appear until I had opened that page.
Otherwise the warning could come from other adapters that are deployed on the same DEV/TEST environment, but I don't know if there would be any. Other adapters would need to have the DirectQuerySender be part of a multi-sender like ParallelSender or ShadowSender.


Bump minimum version of puppet to 3.6

This is to address an issue with OS X versioning
check that prevent OS X 10.10 to run

Related Side note: Are any maintainers running puppet-* module specs with Ruby > 2.0.0?
puppet fails to run in Ruby 2.1 and 2.2. Looks the 2.1 issue is fixed in [current puppet](https://github.com/puppetlabs/puppet/commit/d02820a116d5e3ae0b129a0b4384ddaf76f0f83b] but a note in puppet-boxen's Gemfile says puppet >= 3.4 breaks all the things.

I know personally I am not, I didn't see a need because our-boxen uses the ruby shipped with OSX. We test those versions on the CI.

Fair point. Would it be useful if all puppet-* modules included a ruby-version file set to system, so there would be less confusion?


feat: ngx-pipe lib added, closes #38

Added ngx-pipes library. It closes #38 .

Can we use links from the CHANGELOG please?

Yeah sure. But can you please give me one link in the reply so i can be
sure what do you need.
On Tue, 1 Aug 2023, 12:35 am Enea Jahollari, @.***>
wrote:

Can we use links from the CHANGELOG
https://github.com/danrevah/ngx-pipes/blob/master/CHANGELOG.md please?
—
Reply to this email directly, view it on GitHub
https://github.com/eneajaho/ngx-libs/pull/83#issuecomment-1658977109,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADTFFAP5VWZHHMBF2V5LMR3XS76XFANCNFSM6AAAAAA26SGEVU
.
You are receiving this because you authored the thread.Message ID:
@.***>

Does it seems okey now?

Thanks @rd003