Nan When training

Hi,
Excellent work on the U-Mamba model! I have been attempting to train U-Mamba using my own datasets, which include both 2D and 3D data. However, I've faced an issue where the training process sometimes results in a 'nan' training loss despite trying different datasets. Have you experienced this issue during your training of U-Mamba? I used the nnUNetTrainerUMambaEnc trainer for this process.
Looking forward to your insights.
Best regards,
Leuan

Hi @siny1998 ,
Thanks for your interest.
does the nnUNetTrainerUMambaBot have this issue?

I haven't used the nnUNetTrainerUMambaBot yet. I'll give it a try.

Hi @JunMa11,
I have similar issue when I training on Dataset704_Endovis17 dataset with nnUNetTrainerUMambaEnc. But using nnUNetTrainerUMambaEnc won't have this issue. This is my training logs with command nnUNetv2_train 704 2d all -tr nnUNetTrainerUMambaEnc:
This is the configuration used by this training:
Configuration name: 2d
 {'data_identifier': 'nnUNetPlans_2d', 'preprocessor_name': 'DefaultPreprocessor', 'batch_size': 13, 'patch_size': [384, 640], 'median_image_size_in_voxels': [1080.0, 1920.0], 'spacing': [1.0, 1.0], 'normalization_schemes': ['ZScoreNormalization', 'ZScoreNormalization', 'ZScoreNormalization'], 'use_mask_for_norm': [False, False, False], 'UNet_class_name': 'PlainConvUNet', 'UNet_base_num_features': 32, 'n_conv_per_stage_encoder': [2, 2, 2, 2, 2, 2, 2], 'n_conv_per_stage_decoder': [2, 2, 2, 2, 2, 2], 'num_pool_per_axis': [6, 6], 'pool_op_kernel_sizes': [[1, 1], [2, 2], [2, 2], [2, 2], [2, 2], [2, 2], [2, 2]], 'conv_kernel_sizes': [[3, 3], [3, 3], [3, 3], [3, 3], [3, 3], [3, 3], [3, 3]], 'unet_max_num_features': 512, 'resampling_fn_data': 'resample_data_or_seg_to_shape', 'resampling_fn_seg': 'resample_data_or_seg_to_shape', 'resampling_fn_data_kwargs': {'is_seg': False, 'order': 3, 'order_z': 0, 'force_separate_z': None}, 'resampling_fn_seg_kwargs': {'is_seg': True, 'order': 1, 'order_z': 0, 'force_separate_z': None}, 'resampling_fn_probabilities': 'resample_data_or_seg_to_shape', 'resampling_fn_probabilities_kwargs': {'is_seg': False, 'order': 1, 'order_z': 0, 'force_separate_z': None}, 'batch_dice': True}

These are the global plan.json settings:
 {'dataset_name': 'Dataset704_Endovis17', 'plans_name': 'nnUNetPlans', 'original_median_spacing_after_transp': [999.0, 1.0, 1.0], 'original_median_shape_after_transp': [1, 1080, 1920], 'image_reader_writer': 'NaturalImage2DIO', 'transpose_forward': [0, 1, 2], 'transpose_backward': [0, 1, 2], 'experiment_planner_used': 'ExperimentPlanner', 'label_manager': 'LabelManager', 'foreground_intensity_properties_per_channel': {'0': {'max': 255.0, 'mean':<PHONE_NUMBER>3514101, 'median': 92.0, 'min': 1.0, 'percentile_00_5': 24.0, 'percentile_99_5': 238.0, 'std': 51.584682233895585}, '1': {'max': 249.0, 'mean': 86.51525510193234, 'median': 72.0, 'min': 0.0, 'percentile_00_5': 21.0, 'percentile_99_5': 233.0, 'std': 52.24999179949625}, '2': {'max': 255.0, 'mean': 93.29896387602795, 'median': 79.0, 'min': 0.0, 'percentile_00_5': 21.0, 'percentile_99_5': 244.0, 'std': 56.38243456877845}}}

2024-01-20 11:56:11.330918: unpacking dataset...
2024-01-20 11:56:11.683550: unpacking done...
2024-01-20 11:56:11.684135: do_dummy_2d_data_aug: False
/mnt/disk2/jiarunliu/Documents/mamba/U-Mamba/umamba/nnunetv2/nets/UMambaEnc.py:41: TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!
  assert C == self.dim
2024-01-20 11:56:27.301467: Unable to plot network architecture:
2024-01-20 11:56:27.302820: module 'torch.onnx' has no attribute '_optimize_trace'
2024-01-20 11:56:27.350771:
2024-01-20 11:56:27.350951: Epoch 0
2024-01-20 11:56:27.351222: Current learning rate: 0.01
using pin_memory on device 0
using pin_memory on device 0
2024-01-20 12:01:32.749162: train_loss nan
2024-01-20 12:01:32.749484: val_loss nan
2024-01-20 12:01:32.749587: Pseudo dice [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]
2024-01-20 12:01:32.749661: Epoch time: 305.4 s
2024-01-20 12:01:32.749717: Yayy! New best EMA pseudo Dice: 0.0

So far, this problem only occurs with Dataset704_Endovis17 + nnUNetTrainerUMambaEnc. I'll trying other settings/datasets later.

Another case
Dataset701_AbdomenCT with  nnUNetTrainerUMambaEnc
I put `nnUNetv2_train 701  3d_fullres all -tr nnUNetTrainerUMambaEnc' command
I got nan issue as same as others
I also tried 'nnUNetv2_train 701  3d_fullres all -tr nnUNetTrainerUMambaBot'
it works without nan

As with any training model, the combination of optimiser, trainer, and learning pace seems to matter.
I tried SGD with learning rate 1e-3, much stable than before(default 1e-2)

Hi all,
Thanks for your valuable feedback!
We are testing the model on more datasets. Welcome to subscribe to our update here.

I got the 'Nan' loss too with nnUNetv2_train 701 3d_fullres all -tr nnUNetTrainerUMambaEnc, and I have tried redoing nnUNetv2_plan_and_preprocess -d 701 --verify_dataset_integrity, but it didn't work

I also have this problem when training OCTA dataset

邮件已收到！

Excellent work!  I also faced the same problem on several datasets. Dice, Train_loss, and Val_loss collapsed after 40+ or 200+ epoches randomly. UmambaBot worked but Enc didn't.

@wyjzll I have the same problems with you. UmambaBot worked but Enc didn't.

Hi all,
Thanks for your valuable feedback. After diving into the implementation, we found that AMP will lead to nan.
We have provided new Enc trainers without AMP:
https://github.com/bowang-lab/U-Mamba/blob/main/umamba/nnunetv2/training/nnUNetTrainer/nnUNetTrainerUMambaEncNoAMP.py


Update README with an example for usage in Emacs.

This also gives a section to add configuration examples for other editor such as neovim. I understand if this is not something you feel is in the scope of this project's README, I just think it's something that would make using glslls a little easier.
Thanks for the great project!

Thanks!

Just to mentioned, I've implemented this language server to lsp-mode core, so you don't no longer need this in your Emacs config. :D
See https://emacs-lsp.github.io/lsp-mode/page/lsp-glsl/.

Thanks!

I've opened a PR in #25.


Extend SA1129 to cover parameterless struct constructors

C#10 introduced the ability to declare and use parameterless struct constructors, which means new Struct() and default(Struct) can be different. Consider the following code sample,
using System;

X.L(); // 12
X.K(); // 0

internal struct X
{
    public int I;

    public X()
    {
        I = 12;
    }

    public static void L()
    {
        Console.WriteLine(new X().I);
    }

    public static void K()
    {
        Console.WriteLine(default(X).I);
    }
}

I believe that SA1129 "A value type was constructed using the syntax new T()." should not be removed, rather, it should check whether the struct defines a parameterless constructor before raising any warnings

Duplicate of #3430


chore: fix numpy binary incompatibility issue and add QWEN agent package

안녕하세요, 카카오IF에서 좋은 오픈소스 공개와 발표 감사드립니다.
오픈소스를 사용해보다가 pandas와 numpy에서 아래와 같은 에러가 발생하여 패키지 버전을 수정하였습니다.
Traceback (most recent call last):
  File "/data/public/FunctionChat-Bench/evaluate.py", line 7, in <module>
    from src import utils
  File "/data/public/FunctionChat-Bench/src/utils.py", line 3, in <module>
    import pandas as pd
  File "/usr/local/lib/python3.10/dist-packages/pandas/__init__.py", line 22, in <module>
    from pandas.compat import is_numpy_dev as _is_numpy_dev  # pyright: ignore # noqa:F401
  File "/usr/local/lib/python3.10/dist-packages/pandas/compat/__init__.py", line 25, in <module>
    from pandas.compat.numpy import (
  File "/usr/local/lib/python3.10/dist-packages/pandas/compat/numpy/__init__.py", line 4, in <module>
    from pandas.util.version import Version
  File "/usr/local/lib/python3.10/dist-packages/pandas/util/__init__.py", line 2, in <module>
    from pandas.util._decorators import (  # noqa:F401
  File "/usr/local/lib/python3.10/dist-packages/pandas/util/_decorators.py", line 14, in <module>
    from pandas._libs.properties import cache_readonly
  File "/usr/local/lib/python3.10/dist-packages/pandas/_libs/__init__.py", line 13, in <module>
    from pandas._libs.interval import Interval
  File "pandas/_libs/interval.pyx", line 1, in init pandas._libs.interval
ValueError: numpy.dtype size changed, may indicate binary incompatibility. Expected 96 from C header, got 88 from PyObject

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@with1015
패키지 버전 정리해서 제안해주셔서 감사합니다.


Background

[ ] general background on widespread use of transcriptome assembly - which fields? what insights?
[ ] long runtimes, resource intensive, but complex parameter spaces in all assemblers - optimisation almost never used
[ ] many different tools - all good at different stuff
[ ] reference-based metrics not suitable for optimisation, but new methods for quality analysis of transcriptome assemblies make it possible to compare and rank assemblies without a reference
[ ] assemblers treat the assembly problem as a single puzzle, but in transcriptomes it is really lots of separate puzzles
[ ] assemblotron


Remove K8s 1.31 feature flag and default 1.31 as cluster version

Issue #, if available:
#2399
Description of changes:
This change removes the feature flag for Kubernetes v1.31 support and makes it the default cluster version.
Testing (if applicable):
make build-all-test-binaries
make unit-test
make lint
Documentation added/planned (if applicable):
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve


Feature/update v4

Update to v4

Looking forward to this pull request. Updating this to v4 would now match the current documentation.

Appreciate the PR, sorry I didn't get to it earlier.  The gem has been updated, thanks!


Make the FeatureCard changing its colors two different gradients.

You have to branch out from feature-section branch. create a PR to that branch after finishing.
The FeatureCard is located at src/components/FeatureCard.jsx.
You have to make the background gradient change its color to some colors taken from a matching color array.
You have to decide the matching colors related to the current color I have inserted on.

Hello @supunvindula , can you please elaborate the issue?
you want to change the gradient color on some interaction like click or hover? or just want to change this one ??
I can do both. So please kindly clear me the issue and assign it to me

Hi @Muz4mmil . I need to change gradient colors when the card changes. As you can see the car changes its title and description for every 2 seconds. So with that i want to change the current gradient to another color pair.

Hi @Muz4mmil . I need to change gradient colors when the card changes. As you can see the car changes its title and description for every 2 seconds. So with that i want to change the current gradient to another color pair.

Got it, thanks for explanation. Assign me the task and i'll try to complete. Also, please add other hacktoberfest tags like "hacktoberfest-accepted" because i got some issues on my previous contributions. just a request.

I have assigned you for this task. Please go ahead @Muz4mmil

I have assigned you for this task. Please go ahead @Muz4mmil

Thanks. One more thing, will you suggest some gradients or should i choose according to the website theme and accent?

Go with the website theme and colors looks same like the color gradient now. You can decide

@Muz4mmil Hi any update?

@Muz4mmil Hi any update?

Hello @supunvindula , I am extremely sorry for delay in the completion of the task. As I have my university exams, the schedule is a bit tight.
Will surely complete it in a couple of days.

It is fine @Muz4mmil , But keep in mnd that for hacktoberfest you have to create PRs before the October month ends. Just 3 days to do the tasks. Good luck for your exams btw!!

Hey @supunvindula
I completed the work. Kindly check and Merge it under hacktoberfest.
And thanks for waiting.

Hey @supunvindula
I guess we missed something. or I created a new issue by mistake which got merged.
Because this one is not getting counted in hacktoberfest.
It says 'Not-Participating' in hacktoberfest page
Can you please try adding tags and labels of hacktoberfest and hacktoberfest-accepted to this issue?
Thanks

Issue closed in #2


training/testing set split for gopro dataset

Hi, I download GOPRO_Large_all.zip from https://seungjunnah.github.io/Datasets/gopro.html. I find that there are 33 folders. But I did not see any hint on which folders are of training set or test set. Is this link right?

GoPro_test.txt
GoPro_train.txt
here are the files for the train and test split used in the paper.

Thx!!


Consider introducing a Github merge queue

Currently all branches are merged into main without requiring being up to date with main.
This could mean we merge an old branch that has a breaking change, and the main branch needs to be fixed.
Also, potentially if we introduce stricter static code analysis, potentially this older branch will increase our tech debt
We should consider using a merge queue to avoid this problem: https://docs.github.com/en/repositories/configuring-branches-and-merges-in-your-repository/configuring-pull-request-merges/managing-a-merge-queue
Otherwise we could also enforce that all PRs need to be up to date with main, but I believe that will be far more annoying.

Thoughts @CherryPerry / @zsoltk / @KovalevAndrey ?

We do not need a merge queue but this option instead, it will be enough.

That's probably sufficient, however at least with the merge queue you don't need to keep updating, you just press merge and GitHub will manage multiple merges as long as there are no problems

@KovalevAndrey / @zsoltk thoughts about requiring branches to be up to date? Will avoid master being broken accidentally

@LachlanMcKee it's enabled now.

Thanks!


Dependency Injection / Inversion

To allow Phinx to be fully extensible, it needs to apply Dependency Inversion to allow for dependency injection. The simplest way to approach DI compatibility would be to provide a "class map" that can be overloaded by configuration. This avoids the need to add a container dependency to Phinx.
Along with applying IoC, many methods that have hard-coded lists (eg Column::setOptions) should be split into multiple smaller methods to allow more precise modifications by extension. This helps satisfy the LSP part of SOLID.
Useful links on the subject:

http://aspiringcraftsman.com/2008/12/28/examining-dependency-inversion/
http://www.theserverside.com/news/1321158/A-beginners-guide-to-Dependency-Injection
http://docs.structuremap.net/DependencyInjection.htm
http://richardmiller.co.uk/2011/05/19/when-dependency-injection-goes-wrong/

Anything here to be done still? Or can this be closed?


GCP/A3 doesn't work with torch<2.2 - suggesting to change the deps

GCP/A3 doesn't work with torch<2.2 - so we can't use vllm - this PR is suggesting to relax the deps

Oh, I see there is a PR already: https://github.com/vllm-project/vllm/pull/2804


Don't require VCPKG_FORCE_SYSTEM_BINARIES on arm64 Linux

This is the basic set of changes to the tool to allow having entries in vcpkgTools.xml per-architecture.
Obviously this requires some changes to vcpkgTools.xml. This has been tested on arm64 Linux with
-    <tool name="cmake" os="linux">
+    <tool name="cmake" os="linux" arch="x64">
         <version>3.27.1</version>
         <exeRelativePath>cmake-3.27.1-linux-x86_64/bin/cmake</exeRelativePath>
         <url>https://github.com/Kitware/CMake/releases/download/v3.27.1/cmake-3.27.1-linux-x86_64.tar.gz</url>
         <sha512>192374a68e2971f04974a194645726196d9b8ee7abd650d1e6f65f7aa2ccc9b186c3edb473bb4958c764532edcdd42f4182ee1fcb86b17d78b0bcd6305ce3df1</sha512>
         <archiveName>cmake-3.27.1-linux-x86_64.tar.gz</archiveName>
     </tool>
+    <tool name="cmake" os="linux" arch="arm64">
+        <version>3.27.1</version>
+        <exeRelativePath>cmake-3.27.1-linux-x86_64/bin/cmake</exeRelativePath>
+        <url>https://github.com/Kitware/CMake/releases/download/v3.27.1/cmake-3.27.1-linux-aarch64.tar.gz</url>
+        <sha512>de458163eb066efe76ab3ece2e0781d1e3d3091b1eda00d9f49b323ada1f65ab9138c52e1af5e6fe74dbd4a4327d4185336c71a9c7430bb5817962ece5696fc1</sha512>
+        <archiveName>cmake-3.27.1-linux-aarch64.tar.gz</archiveName>
+    </tool>

applied to vcpkgTools.xml.
Is there potentially interest in this? My usecase is I'd really like to use this arm64 Linux machine for development (a Mac Studio), and have it be able to download binarycache'd artifacts from our server. The problem with FORCE_SYSTEM_BINARIES is that it sets verison 0 in for cmake in the ABI, so it has to recompile everything. This combined with --host-triplet lets me download the binary cache.
Opening as draft because it requires parallel changes to vcpkgTools.xml, so the PR cannot be merged without a plan on how to do that.

I would like to see lifting the lid on this area to completely eliminate vcpkgTools.xml; needing to better handle host cpu, in particular host arm-windows and arm-linux, is something we indeed need to do better at.
See also:

https://github.com/microsoft/vcpkg/issues/28570
https://github.com/microsoft/vcpkg/issues/34495
https://github.com/microsoft/vcpkg/issues/21482

Yeah makes sense. Parsing that XML file with regex does not seem ideal to me, ha. Gave me a laugh as I was reminded of https://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags/1732454#1732454

Yeah makes sense. Parsing that XML file with regex does not seem ideal to me, ha. Gave me a laugh as I was reminded of https://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags/1732454#1732454
(of course in practice it's fine considering the xml file is entirely controlled by yall)

The XML file exists due to long Long ago before we had vcpkg binaries at all, where bootstrap-vcpkg.sh was also parsing the XML file with regex and this was done to be consistent with that. Now that all the platforms where vcpkgTools.xml had any meaning have binaries available, it doesn't really need to exist anymore.

See also #868

I am experiencing something that may be related, but I am unsure (I am not too familiar with vcpkg):
@russelltg Are you using docker? If so, are you able to build with docker on apple silicon with platform emulation? If so, what is your typical route to doing this? For ex. I can docker build fine on a metal amd64 server, but when I run with docker build --platform=linux/amd64 on my M1 I get build errors for all attempted builds. If this is a different issue, I could open one, please let me know.

Seems different. I'm building from native arm64 Linux.

thanks. But +1 for not requiring VCPKG_FORCE_SYSTEM_BINARIES.


Remove words

The word "Niger" is refering to a countrry and "Nigerian" to a "Niger" citizen.

Wow. Thanks for catching that. Fixed.


BUG: Behaviour differs if ray is imported and or initialized manually. Without manual import: it fails

Modin version checks

[X] I have checked that this issue has not already been reported.

[X] I have confirmed this bug exists on the latest released version of Modin.

[ ] I have confirmed this bug exists on the main branch of Modin. (In order to do this you can follow this guide.)

Reproducible Example
# I tried getting close to my actual data here, but the individual breaking point will depend on the hardware I assume

import os
os.environ["MODIN_ENGINE"] = "ray"

# import ray
# ray.init()

import modin.pandas as pd
import numpy as np

def generate_dataframes(num_dataframes, num_rows, num_columns):
    dataframes = []
    for _ in range(num_dataframes):
        df = pd.DataFrame(np.random.rand(num_rows, num_columns))
        dataframes.append(df)
    return dataframes

# Parameters
num_dataframes = 1200
num_rows = 1000000
num_columns = 12

dataframes = generate_dataframes(num_dataframes, num_rows, num_columns)

big_df = pd.concat(dataframes, ignore_index=True)

big_df.to_parquet('big_df.parquet')

Issue Description
Writing this a second time because the first time my computer bluescreened (not the first time while troubleshooting this issue)
I am running modin with ray on my laptop, no cluster.
I am loading a file in batches, creating dfs from the batches, and concatenating them together.
Then I try to save it using '.to_parquet()'
Depending on how and what I import, I get different results:
Import only modin:
import modin.pandas as pd

Concatenating the dataframes takes a very long time and needs a lot of ram.

Importing ray manually:
import ray
import modin.pandas as pd

concatenating works just as before,
trying to save to parquet fills RAM and pagefile (violently) until my computer freezes or bluescreens. The freeze is so extreme the only thing i can still do is cut the power.
Importing ray manually AND calling ray.init()
import ray
ray.init()
import modin.pandas as pd

This initializes 2 ray instances sadly, but:
Leads to WAY faster df concatenation, and saving with to_parquet() also works (most of the time)
In both operations it also barely fills up my ram (pagefile is chilling)
(did manage to bluescreen here once as well though, might be unrelated)
It creates a .parquet folder with 20 parquet files in it with about 1.5gigs each
Whats going on here?
I just found out because I needed the ray dashboard to debug, so i called init manually, but then the issue was gone.
Also, on a different note:
I cant actually load the parquet folder again that i just saved. Instant running OOM. Even though the same data in just one .parquet file loads flawlessly in just a second. whats up with that?
Related to https://github.com/modin-project/modin/issues/7020#issuecomment-2263358385 ?
Expected Behavior
I would expect that the default import leads to good results. As it seams something is not adding up.
Error Logs

Replace this line with the error backtrace (if applicable).


Update stm32g0 to 0.15.1

I see there have already been two attempts to update this dependency, blocked by the malformed SVD for the new MCUs. This CL doesn't try to add any new MCUs directly; it just updates a dependency.
I plan to add G0B1 MCU later, which is unaffected by the SVD problem.

Hi thanks for the PR. Could you run cargo fmt, it currently fails because of formating..

Done.

I was trigger happy and merged it without seeing that some tests failed.


Erroneous sub-triangle

Under some conditions, pyacvd produces incorrect triangles, as seen in the image below:

The small triangle is indeed inside the large one, resulting in incorrect half-edge structure. Changing the number of subdivsions or the cluster parameter solves this. However, it is inconvenient to rerun the whole application once this pops up.
Could you help me with this? I can provide input files to reproduce the issue.

I get a lot of these and I'm wondering which filters I can use to clean them up. It's hard to tell but I assume that's three complete triangles sharing one edge, and two of the triangles lie on the same plane. In region of high curvature I also get three triangles sharing one edge, but instead of the coincident triangles, one triangle juts out of the surface like a pointy tooth.


Adding test 'cat' into Readme.MD

Resolves #001
Description

Type of change

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
This change requires a documentation update
Documentation update

How Has This Been Tested?

Screenshots

Heads up for anyone who sees this, I asked @tjaRoxasXIII to make this PR to learn how to open PRs :). Ignore this PR folks


2 columns of 2-column elements to 1 column of 2-column elements

Is this layout a possibility with mjml? It is a common design pattern and I am wondering how to approach

nested columns - elements containing image and text side by side, in a grid of other such elements
at the small screen breakpoint have the grid layout of elements switch to one column, but the individual element layout remain the same

Trying to answer my own questions: should I expect issues with the following code?
<mjml>
  <mj-body>
    <mj-container>
      <mj-section>
        <mj-column>

          <mj-image width="100" src="/assets/img/logo-small.png"></mj-image>

          <mj-divider border-color="#F45E43"></mj-divider>

          <mj-text font-size="20px" color="#F45E43" font-family="helvetica">Hello World</mj-text>

        </mj-column>
      </mj-section>
      <mj-section>
        <mj-column>
          <mj-text>

                  First Name Title

 Email

 Phone

          </mj-text>
        </mj-column>

        <mj-column>
          <mj-text>

                  First Name Title

 Email

 Phone

          </mj-text>
        </mj-column>

      </mj-section>
    </mj-container>
  </mj-body>
</mjml>

You could switch to mj-table and remove mj-text but I think you've got it.
You may be able to use mj-group with 2cols per group alternatively, I think.
On 11 Jan 2017 20:48, "Andrei Andreev"<EMAIL_ADDRESS>wrote:

Trying to answer my own questions: should I expect issues with the
following code?

      <mj-image width="100" src="/assets/img/logo-small.png"></mj-image>

      <mj-divider border-color="#F45E43"></mj-divider>

      <mj-text font-size="20px" color="#F45E43" font-family="helvetica">Hello World</mj-text>

    </mj-column>
  </mj-section>
  <mj-section>
    <mj-column>
      <mj-text>

              First Name Title

 Email

 Phone

      </mj-text>
    </mj-column>

    <mj-column>
      <mj-text>

              First Name Title

 Email

 Phone

      </mj-text>
    </mj-column>

  </mj-section>
</mj-container>

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mjmlio/mjml/issues/494#issuecomment-271974535, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AKxLOGMUip0WBgpLgrxVEwyoOhBvV6fvks5rRTIogaJpZM4Lg-2T
.

Hi @andreimoment
This is exactly how i'd do it @andreimoment

Thank you!


Add heatmap download

This PR adds download capability for the classic associations heatmap table. It will iteratively call the API if necessary to get all rows.

Fixes https://github.com/opentargets/platform/issues/746.


sudo make install failed

Describe the bug
A clear and concise description of what the bug is.
The following error occurred when I used sudo make install to install arkime, causing the arkime installation to fail
Elasticsearch version:
7.10.2
Arkime/Moloch version:
4.0.2
OS name and version:
ubuntu20.04
How was Arkime/Moloch built/installed: (rpm, deb, easybutton, ...)
easybutton
Provide logs, stack traces and steps to reproduce:
npm ci
npm WARN prepare removing existing node_modules/ before installation

<EMAIL_ADDRESS>install /root/arkime-main/node_modules/re2
install-from-cache --artifact build/Release/re2.node --host-var RE2_DOWNLOAD_MIRROR --skip-path-var RE2_DOWNLOAD_SKIP_PATH --skip-ver-var RE2_DOWNLOAD_SKIP_VER || npm run rebuild

Trying https://github.com/uhop/node-re2/releases/download/1.17.7/linux-x64-64.br ...
Trying https://github.com/uhop/node-re2/releases/download/1.17.7/linux-x64-64.gz ...
Building locally ...

<EMAIL_ADDRESS>rebuild /root/arkime-main/node_modules/re2
node-gyp rebuild

Traceback (most recent call last):
File "/usr/share/nodejs/node-gyp/gyp/gyp_main.py", line 6, in
from pkg_resources import load_entry_point
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3254, in
def _initialize_master_working_set():
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3237, in _call_aside
f(*args, **kwargs)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3266, in _initialize_master_working_set
working_set = WorkingSet._build_master()
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 584, in _build_master
ws.require(requires)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 901, in require
needed = self.resolve(parse_requirements(requirements))
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 787, in resolve
raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'gyp==0.1' distribution was not found and is required by the application
gyp ERR! configure error
gyp ERR! stack Error: gyp failed with exit code: 1
gyp ERR! stack     at ChildProcess.onCpExit (/usr/share/nodejs/node-gyp/lib/configure.js:355:16)
gyp ERR! stack     at ChildProcess.emit (events.js:198:13)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)
gyp ERR! System Linux 5.15.0-52-generic
gyp ERR! command "/usr/bin/node" "/usr/bin/node-gyp" "rebuild"
gyp ERR! cwd /root/arkime-main/node_modules/re2
gyp ERR! node -v v10.19.0
gyp ERR! node-gyp -v v6.1.0
gyp ERR! not ok
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>rebuild: node-gyp rebuild
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>rebuild script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm WARN Local package.json exists, but node_modules missing, did you mean to install?
npm ERR!  This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)
(node:671410) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

<EMAIL_ADDRESS>install /root/arkime-main/node_modules/msgpackr-extract
node-gyp-build

Traceback (most recent call last):
File "/usr/share/nodejs/node-gyp/gyp/gyp_main.py", line 6, in
from pkg_resources import load_entry_point
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3254, in
def _initialize_master_working_set():
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3237, in _call_aside
f(*args, **kwargs)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3266, in _initialize_master_working_set
working_set = WorkingSet._build_master()
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 584, in _build_master
ws.require(requires)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 901, in require
needed = self.resolve(parse_requirements(requirements))
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 787, in resolve
raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'gyp==0.1' distribution was not found and is required by the application
gyp ERR! configure error
gyp ERR! stack Error: gyp failed with exit code: 1
gyp ERR! stack     at ChildProcess.onCpExit (/usr/share/nodejs/node-gyp/lib/configure.js:355:16)
gyp ERR! stack     at ChildProcess.emit (events.js:198:13)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)
gyp ERR! System Linux 5.15.0-52-generic
gyp ERR! command "/usr/bin/node" "/usr/bin/node-gyp" "rebuild"
gyp ERR! cwd /root/arkime-main/node_modules/msgpackr-extract
gyp ERR! node -v v10.19.0
gyp ERR! node-gyp -v v6.1.0
gyp ERR! not ok

<EMAIL_ADDRESS>install /root/arkime-main/node_modules/lmdb-store
node-gyp-build

Traceback (most recent call last):
File "/usr/share/nodejs/node-gyp/gyp/gyp_main.py", line 6, in
from pkg_resources import load_entry_point
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3254, in
def _initialize_master_working_set():
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3237, in _call_aside
f(*args, **kwargs)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 3266, in _initialize_master_working_set
working_set = WorkingSet._build_master()
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 584, in _build_master
ws.require(requires)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 901, in require
needed = self.resolve(parse_requirements(requirements))
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 787, in resolve
raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'gyp==0.1' distribution was not found and is required by the application
gyp ERR! configure error
gyp ERR! stack Error: gyp failed with exit code: 1
gyp ERR! stack     at ChildProcess.onCpExit (/usr/share/nodejs/node-gyp/lib/configure.js:355:16)
gyp ERR! stack     at ChildProcess.emit (events.js:198:13)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)
gyp ERR! System Linux 5.15.0-52-generic
gyp ERR! command "/usr/bin/node" "/usr/bin/node-gyp" "rebuild"
gyp ERR! cwd /root/arkime-main/node_modules/lmdb-store
gyp ERR! node -v v10.19.0
gyp ERR! node-gyp -v v6.1.0
gyp ERR! not ok
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>install: node-gyp-build
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR!


Invalid cast exception

I have this method right here
`public IEnumerable FindAll(List<Expression<Func<TEntity, object>>> includes)
{
LiteCollection query = null;
		foreach (Expression<Func<TEntity, object>> inclusion in includes)
		{
			query = query == null ? _entities.Include(inclusion) : query.Include(inclusion);
		}

		return query.FindAll();
	}`

upon first inserting of the data it retrieves the secondary objects fine. however when i close the application and re-run it, i receive this InvalidCastException when trying to retrieve the data and include sub objects.

here are some stack traces
at (wrapper castclass) System.Object:__castclass_with_cache (object,intptr,intptr)
at LiteDB.PageService.GetPage[T] (System.UInt32 pageID) [0x0005a] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.DataService.GetBlock (LiteDB.PageAddress blockAddress) [0x00000] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.DataService.Read (LiteDB.PageAddress blockAddress) [0x00000] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.LiteEngine+d__9.MoveNext () [0x00151] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.LiteCollection`1+d__17[T].MoveNext () [0x0010b] in <759e1574e773400eac7ecc15e78b8c77>:0
at JWCompanion.PersonalStudy..ctor () [0x000ea] in /Users/v6xk2/Projects/DefaultCollection/_git/JWCompanion/JWCompanion/Views/PersonalStudy.xaml.cs:40
at (wrapper managed-to-native) System.Reflection.MonoCMethod:InternalInvoke (System.Reflection.MonoCMethod,object,object[],System.Exception&)
at System.Reflection.MonoCMethod.InternalInvoke (System.Object obj, System.Object[] parameters) [0x00002] in /Users/builder/data/lanes/3969/7beaef43/source/xamarin-macios/_ios-build/Library/Frameworks/Xamarin.iOS.framework/Versions/git/src/mono/mcs/class/corlib/System.Reflection/MonoMethod.cs:661
System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.InvalidCastException: Specified cast is not valid.
at at (wrapper castclass) System.Object:__castclass_with_cache (object,intptr,intptr)
at LiteDB.PageService.GetPage[T] (System.UInt32 pageID) [0x0005a] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.DataService.GetBlock (LiteDB.PageAddress blockAddress) [0x00000] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.DataService.Read (LiteDB.PageAddress blockAddress) [0x00000] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.LiteEngine+d__9.MoveNext () [0x00151] in <759e1574e773400eac7ecc15e78b8c77>:0
at LiteDB.LiteCollection`1+d__17[T].MoveNext () [0x0010b] in <759e1574e773400eac7ecc15e78b8c77>:0
at JWCompanion.PersonalStudy..ctor () [0x000ea] in /Users/v6xk2/Projects/DefaultCollection/_git/JWCompanion/JWCompanion/Views/PersonalStudy.xaml.cs:40
at at (wrapper managed-to-native) System.Reflection.MonoCMethod:InternalInvoke (System.Reflection.MonoCMethod,object,object[],System.Exception&)
at System.Reflection.MonoCMethod.InternalInvoke (System.Object obj, System.Object[] parameters) [0x00002] in /Users/builder/data/lanes/3969/7beaef43/source/xamarin-macios/_ios-build/Library/Frameworks/Xamarin.iOS.framework/Versions/git/src/mono/mcs/class/corlib/System.Reflection/MonoMethod.cs:661
--- End of inner exception stack trace ---
at at (wrapper managed-to-native) UIKit.UIApplication:UIApplicationMain (int,string[],intptr,intptr)
at UIKit.UIApplication.Main (System.String[] args, System.IntPtr principal, System.IntPtr delegate) [0x00005] in /Users/builder/data/lanes/3969/7beaef43/source/xamarin-macios/src/UIKit/UIApplication.cs:79
at UIKit.UIApplication.Main (System.String[] args, System.String principalClassName, System.String delegateClassName) [0x00038] in /Users/builder/data/lanes/3969/7beaef43/source/xamarin-macios/src/UIKit/UIApplication.cs:63
at JWCompanion.iOS.Application.Main (System.String[] args) [0x00000] in /Users/v6xk2/Projects/DefaultCollection/_git/JWCompanion/iOS/Main.cs:17
my objects looks like this
`public class PersonalStudies : JWPoco
{
public string StudyTopic { get; set; }
	//[BsonIgnore]
	public DateTime StudyDate { get; set; }

	[BsonIgnore]
	public List<Note> AttachedNotes { get; set; }

	[BsonIgnore]
	public List<Tag> AttachedTags { get; set; }

	#region foreignKeys
	[BsonRef("note")]
	public List<Note> Notes { get; set; }

	[BsonRef("tag")]
	public List<Tag> Tags { get; set; }
	#endregion
}`

found a work around. at the moment this is no longer an issue

What workaround?

@Raiondesu i just made sure that the database wasn't dirty anymore and all connections to it were disposed then it began working properly with the bson ref pulling in linked classes


unable to access get_instance() on pre_controller hooks.

As the docs said:

pre_controller Called immediately prior to any of your controllers being called. All base classes, routing, and security checks have been done.

Does this mean it count the get_instance()? I tried to var_dump the get_instance(), it return null. But once I changed the hook point onto post_controller_constructor (and the rest points) it returns the instance.
As the docs said:

post_controller_constructor Called immediately after your controller is instantiated, but prior to any method calls happening.

My questions are:

Is this the design? I mean, like it is not possible and such?

Is it possible to access the CodeIgniter's instance inside the pre_controller? If yes, how?

Uh, okay...?
I'm straight to the point. I need Uri and Cache libraries to be loaded on pre_controller for HTTP caching and rate limiting. It's something like this: https://www.digitalocean.com/community/tutorials/how-to-implement-php-rate-limiting-with-redis-on-ubuntu-20-04
It requires a client identifier. The article mentions IP address, but in my case, i might going to use token served as cookie.

There are some ways of hooking into pre-controller's-method (because this seems to be what you are trying to do). Please read the user guide thoroughly, it has many examples and situations very well explained and what to do for those.
If you need further help specifically for your own project, remember that we recommend people to use the forums.

Uh, okay...?

I suppose you didn't catch what I was saying.
As I already said, get_instance() returns the controller instance. At the same time, 'pre_controller' literally means "before controller". That is, of course, you cannot have the controller before the controller exists - otherwise it would be quite the paradox, wouldn't it? :)
It is possible to get the URI and Cache libraries without going through the controller, but you should really, really know what you're doing. If you can't figure it out yourself, then as unhelpful as this might seem, it's just not a good idea.


Documentation search is not very effective

Describe the bug
Hey, not a bug with the codebase, but worth noting, it seems like the search bar is kinda... bad?

Seems like it very rarely returns results, even on exact text matches.
Expected behavior
Search should search
Actual behavior
Search does not seem to work very well
Steps to reproduce the problem

Do a search

Versions

Komapper: N/A
Kotlin: N/a
JVM: N/A
JDBC Driver or R2DBC Driver: N/A
Database: N/A
OS: N/A

Hi, thank you for your report.
We will consider changing the Algolia crawler settings.

We have changed the settings.
Please check it.

Amazing, seems much better, thanks!
I did a PoC using komapper r2dbc yesterday and it was really promising, thanks for this project


Improve Properties

Pull Request Test Coverage Report for Build 168

16 of 23 (69.57%) changed or added relevant lines in 4 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-1.0%) to 70.566%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/main/scala/org/codefeedr/utilities/Http.scala
0
1
0.0%

src/main/scala/org/codefeedr/pipeline/buffer/KafkaBuffer.scala
0
6
0.0%

Totals

Change from base Build 165:
-1.0%

Covered Lines:
187

Relevant Lines:
265

💛  - Coveralls


Add rollup config

PoC.
Purpose: make bundled voby available on npm.
I didn't know how the build pipeline of this package works so I didn't touch it. I could have also added an iife bundle, but voby doesn't support being set as window.voby (I think).
To bundle: npm compile && npm bundle
When running the above command, rollup outputs a warning: "circular dependency". Maybe this is concerning?

There's a circular dependency in Oby but I think it's an acceptable one.
I'm not sure I see the reason for shipping it in bundled form, generally I don't do that. Why do you want this?

I wanted to use voby on my own site. To do that, I needed to copy all the voby files, which is a lot of files.
I think bundled script get executed faster, since there is no need to wait for script to parse, then import, then wait for script to parse, then import, then...

There are benefits to bundling, but in general in scenarios like this the end user would just use Vite. Have you considered it? Like in general you are not going to find all your dependencies to ship already pre-bundled, normally.

🤔 I don't know I think having a bundler is entirely within the end user's power, and they should probably use one. I think it's probably best to not merge this. It could be revised in the future if somehow this becomes a major use case in the future and people really want it.

@iacore I haven't tried it yet but I think there are some CDN services for this, for ex https://esm.sh/voby?bundle-deps might give you a single file for easy copy-paste. Or if you're using a module script you can import directly from there.


x:instance-of-namespace() for XQuery

This pull request derives from #486. So needs to be handled after that.

This pull request provides x:instance-of-namespace() to XQuery.

af0584fc95d545a59d01737f5cf07df9545abae7 renames xspec-utils.xspec to xspec-utils_stylesheet.xspec to indicate that it's only for XSLT
8e46964020bd3a7678c16f95400096effcb12a8b implements the function
399327d5f206287643de18bbb52ace28d95c6e41 makes the function available in main XQuery
90fbe3be3b55f7726bb2d11c55b793a98025a361 tests the function both on XSLT and XQuery

This pull request prepares to make XQuery more compatible with XSLT.

@cirulls
Merged this enhancement.


Ready. Rename "binary" cells/columns to "varchar" to match recent changes.

+1 d122f08ea1229e6bdb5df2edeaa95595f651bac8


Remove semicolon from text/plain content type in example Swagger specs

The extra semicolon causes a NonConformingResponseHeaders exception
when response validation is enabled for the Swagger spec in these examples.

coverage: 94.419%. remained the same
when pulling e9337d71b1b21924ceab87513521a12e3465f273 on chrisinmtown:examples-swagger-semicolon
into 1844a2fb3f1d09a37edfeab7a7200d52e97abbd9 on spec-first:main.


Define frontend purpose

There is some text to clear up from a previous merge conflict but at this point the frontend service has (or should still have) the following functionalities:

authenticate a user
make authorized requests to the API

TLS remains unimplemented on the client and that may be something that requires specific setup configuration by AWS.
However, the majority of the frontend repo remains vague and tasks should be defined for it.
Here are some options that I think would be good to work towards:

create a dashboard that showed the status of the running client service
create a visualization dashboard that represents the event types being read by the client

To make a request for the data, an api will be needed between the destination service (AWS) and frontend. The existing api repo could be used for that but there is a way to remove the need to have an api repo and give its responsibility to the frontend svelte application.

The Front-end will be archived for now. So far, we are using Svelte with auth0 for authentication, but we decided to focus on and prioritize the functionality of the log collection system rather than the appearance.
I think it would be cool to have a front-end, but it should be minimized as a priority.
Let's open the front-end repo for now but not integrate it for any purpose.


How to handles failures?

As github.com provides a high availability web site that most likely will not fail or be not available, it is not perfect to show edge cases with your REST Calls.
REST request can fail for many reasons like server is down, network issues, content gets scrambled, response delays.
Wiremock has some built in features to simulate failures: http://wiremock.org/docs/simulating-faults/.
The faults need some API endpoints on a Wiremock http server, therefore different API endpoints than https://api.github.com.
How should Wiremock be integrated into this example?
One option would be to extract the called endpoints into configurable settings with smart defaults.
Another option would be to create other test processes that call wiremock endpoints. They can be used to react on single failures in a Unit test or even show a huge load on the process engine calling delayed service endpoints.
What do you prefer? One or two, even both or more options?

I've added a branch (failing-rest-calls) with a new process and a wiremock setup to try some examples: https://github.com/camunda-community-hub/Make-Rest-Calls-From-Camunda-Example/tree/failing-rest-calls


Allow Ubuntu 20.04 to be used

Docker images are based on Ubuntu 20.04 LTS actually! Proceeding with test env upgrade.

Codecov Report

Merging #2068 (24ab46c) into development (81abc68) will decrease coverage by 21.60%.
The diff coverage is n/a.

@@               Coverage Diff                @@
##           development    #2068       +/-   ##
================================================
- Coverage        88.13%   66.53%   -21.61%
================================================
  Files             1788     1306      -482
  Lines            61470    35459    -26011
================================================
- Hits             54177    23592    -30585
- Misses            7293    11867     +4574

Impacted Files
Coverage Δ

spec/support/concerns/random_token_methods.rb
2.63% <0.00%> (-97.37%)
:arrow_down:

spec/support/concerns/request/api.rb
11.11% <0.00%> (-88.89%)
:arrow_down:

app/models/identifier/global/issn.rb
14.28% <0.00%> (-85.72%)
:arrow_down:

app/models/identifier/global/isbn.rb
8.33% <0.00%> (-85.42%)
:arrow_down:

app/models/protonym/becomes.rb
16.43% <0.00%> (-79.46%)
:arrow_down:

app/models/identifier/global/orcid.rb
22.22% <0.00%> (-77.78%)
:arrow_down:

app/models/identifier/global/lccn.rb
11.53% <0.00%> (-76.93%)
:arrow_down:

lib/batch_load/import/otus.rb
24.24% <0.00%> (-75.76%)
:arrow_down:

app/models/geographic_item/geometry_collection.rb
20.58% <0.00%> (-73.53%)
:arrow_down:

...odels/identifier/global/gen_bank_accession_code.rb
27.27% <0.00%> (-72.73%)
:arrow_down:

... and 986 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 81abc68...24ab46c. Read the comment docs.


Using custom templates to parse output does not work anymore

What happened:
Starting from v0.102.0 using templates to parse Syft's output does not work.
What you expected to happen:
We get Syft's output data even with a template.
Steps to reproduce the issue:
The README provides an example of a custom template file csv.tmpl:
"Package","Version Installed","Found by"
{{- range .Artifacts}}
"{{.Name}}","{{.Version}}","{{.FoundBy}}"
{{- end}}

Using this template with Syft v0.102.0 or higher gives a blank csv file:
"Package","Version Installed","Found by"

whereas on lower version it works.
Anything else we need to know?:
Environment:

OS (e.g: cat /etc/os-release or similar): MacOS Sonoma 14.3

Hi @amascia-gg, sorry, we need to update the README to match. This is one of the breaking changes in Syft 0.102.0 -- you can read more about it on this issue: https://github.com/anchore/syft/pull/2542 -- the motivation behind this change was to make it easier to write template--previously, the templates accessed the internal Go data structures, but now the template uses the JSON object. You can run syft -o json ... to get the JSON version of your SBOM to see the data structure and the fields you have access to.
To solve your problem temporarily (without changing your templates), you can set the environment variable SYFT_FORMAT_TEMPLATE_LEGACY=1 or make the change in your syft configuration file.
Thank you for letting us know about the outdated README. Please let us know if you have any trouble and we can give you some more advice. Thanks!


nonProxyHostes config missed

It looks like that it's not possible to configure http.nonProxyHosts parameter.
In the RedmineManagerFactory class only http.proxyHost and http.proxyPort are considered.

do you have a fix for this issue?

Hello Alexey.
I put something here but not tested enough. I am not fluent in java:
https://github.com/uolter/redmine-java-api

RedmineManagerFactory  has createDefaultHttpClient() method that allows you to provide a pre-configured Apache HttpClient instance with nonProxyHosts and whatever other settings you need.
it would be nice to support nonProxyHosts for default Http Client created in this class RedmineManagerFactory   if none is provided, but since nobody is willing to dig into this and submit a functional PR, I'm going to close this.
this is largely out of scope of this library.


WANT TO SEE HOT PICS WITH ME? 💋 💋 💋

WANT TO SEE HOT PICS WITH ME? 💋 💋 💋
👇 👇 👇
https://is.gd/ms4xm3

add to cart :shopping_cart:

too bad i already gave all my money to that nigerian prince :sob:

too bad i already gave all my money to that nigerian prince :sob:


Object Attributes

I was looking for a way to easily pass all of an object's attributes to the controller instead of having to specify each attribute separately. When I did this...
<div data-controller="my-controller" data-my-controller-attributes="<%= @user.attributes %>">

To my surprise I got (example)...
<div data-controller="my-controller" data-my-controller-attributes-id="1" data-my-controller-attributes-name="Bob"<EMAIL_ADDRESS>...
Is this documented anywhere? It's great but does throw a lot of stuff on the page which I was trying to avoid but glad it did it for me automatically. Is there a better way?
Also, probably very risky security wise.

Can you share an example of your controller code or minimal steps to reproduce?


[FLINK-20997][tests] Generate yarn classpath before test phase

What is the purpose of the change
YarnTestBase depends on classpaths generated by Maven dependency plugin in package phase, but YarnTestBaseTest is a unit test that executed in test phase (which is before package), so it's unable to find yarn.classpath and causes NPE.
Brief change log
Make the classpath generated in process-test-resources phase.
Verifying this change
This change is already covered by existing tests.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

The build on Azure is quite customized (compile and test execution are executed separately) .. that's why this oversight didn't surface earlier.
Thanks a lot for this fix! Merging!

The build on Azure is quite customized (compile and test execution are executed separately) .. that's why this oversight didn't surface earlier.
Thanks a lot for this fix! Merging!


fixed bug with scaling of domains / annotated regions

Fixes bug #86
Its a nice tidy pull request that only deletes two lines (one was unnecessary cruft, the other was the cause of the bug).

Does that mean we need to update our local instances (Editor, CP website)?

On 24/02/16 11:56, Birgit wrote:

Does that mean we need to update our local instances (Editor, CP website)?

yes.
You can check its working as expected first at http://interactionviewer.org
I'll close issue / merge / release when we know its all fixed.
C

—
Reply to this email directly or view it on GitHub
https://github.com/MICommunity/interaction-viewer/pull/87#issuecomment-188219728.

The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

Ready to update our instances, @tschaka1904


Update footer.mustache

Codecov Report

Merging #297 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master   #297   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           5      5
  Lines         160    160
=====================================
  Hits          160    160

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e2d3ab3...a62a6fe. Read the comment docs.

Thanks for spotting this!

@mjarvis can you do the contributor addition stuff? :)

Thanks @wesharehoodies! Like all contributors I'll invite you to the ReSwift org. That will make future contributions easier in case you are interested! 🎉
@DivineDominion 😛 Copy-paste-invite!

👍  It wasn't worried about the text, I just cannot invite members myself :)

@DivineDominion oh, sorry! Thats odd -- I'll check in with @Ben-G but I feel like you should have access to that.

Don't bother, I'm better at responding to people than managing the repo with my limited OSS experience anyway :)


With Karabiner on, the event.modifierFlags values change with 8 off and 29 on.

With Karabiner enabled, the event.modifierFlags values are different (at least for Cmd and Option keys).
For example:

In the case of Left Command, they change from 0x100108 to 0x20100008. I.e. Bits 3, 8, 20 become 3, 20, 29.
In the case of Left Option, they change from 0x80120 to 0x20080020. I.e. Bits 5, 8, 19 become 5, 19, 29.

It looks like for some reason the 8th bit is being set to off and the 29th to on. This is causing, for example, event.modifierFlags & NSDeviceIndependentModifierFlagsMask == NSCommandKeyMask to no longer be true because of the 29th bit being on.
These values were read from an event tap with no configuration file for Karabiner on a MacBook Air.
This is the cause of https://github.com/tekezo/Karabiner-Elements/issues/147 and possibly others like https://github.com/tekezo/Karabiner-Elements/issues/135?
If there is something else I can help investigate please let me know.

Hi @tekezo, I investigated this a bit more. The 8th bit is for NX_NONCOALSESCEDMASK. However, I haven't been able to figure out what is the 29th bit for? Any idea why/where Karabiner sets it to on?


Export prometeus metrics

In GitLab by @paul.laffitte on Jan 12, 2021, 21:55

In GitLab by @paul.laffitte on Feb 2, 2021, 11:56
require #55

closed by 6c06ed845111364e08be62d18c7ec173889f69f2


Updation of links to current docs for SUSE

Updation of links to current docs for SUSE- https://aka.ms/suse-ahb

Microsoft authors of articles need to make updates through the private repository so the updates can be staged and validated by the current validation rules. After you review staging and fix all validation issues, you can add the sign-off comment to let the PR reviewers know the updates are ready to be merged.It's easy to access the private repo version of your articles in GitHub. Just add -pr to the URL, as follows:
Public repo URL: https://github.com/MicrosoftDocs/{docs-repo}
Private repo URL: https://github.com/MicrosoftDocs/{docs-repo-pr}
We have closed this pull request. Please resubmit the updates through the private repo. For more information, [see the contributor guide].(https://docs.microsoft.com/en-us/contribute/)


MaskedAutoregressiveFlow example (tf.contrib.distributions) raises ValueError

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Google Colab (also tried on a Windows 10 machine with TF 1.6)
TensorFlow installed from (source or binary): defaults from Colab
TensorFlow version (use command below): 1.6.0
Python version: 3.6.3 (default, Oct  3 2017, 21:45:48)
Bazel version (if compiling from source): N/A
GCC/Compiler version (if compiling from source): N/A
CUDA/cuDNN version: N/A
GPU model and memory: N/A
Exact command to reproduce: see attached file

Describe the problem
I'm new to tf.contrib.distributions. I've just copied the example for MaskedAutoregressiveFlow from https://www.tensorflow.org/api_docs/python/tf/contrib/distributions/bijectors/MaskedAutoregressiveFlow. Running the example fails with a ValueError at maf.sample(). See the attached file and error log below.  Running tf.global_variables_initializer() in the session doesn't solve it either. It looks like masked_autoregressive_default_template expects a tensor with ndim>1 but MaskedAutoregressiveFlow.forward() passes a tensor with ndim=1.
masked_autoregressive_issue.txt
Source code / logs
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-3-646c58f4e818> in <module>()
     12 sess.run(tf.global_variables_initializer())
     13
---> 14 x = maf.sample()  # Expensive; uses `tf.while_loop`, no Bijector caching.
     15 maf.log_prob(x)   # Almost free; uses Bijector caching.
     16 maf.log_prob(0.)  # Cheap; no `tf.while_loop` despite no Bijector caching.

/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/distributions/distribution.py in sample(self, sample_shape, seed, name)
    687       samples: a `Tensor` with prepended dimensions `sample_shape`.
    688     """
--> 689     return self._call_sample_n(sample_shape, seed, name)
    690
    691   def _log_prob(self, value):

/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/distributions/transformed_distribution.py in _call_sample_n(self, sample_shape, seed, name, **kwargs)
    411       # work, it is imperative that this is the last modification to the
    412       # returned result.
--> 413       y = self.bijector.forward(x, **kwargs)
    414       y = self._set_sample_static_shape(y, sample_shape)
    415

/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/distributions/bijector_impl.py in forward(self, x, name)
    618       NotImplementedError: if `_forward` is not implemented.
    619     """
--> 620     return self._call_forward(x, name)
    621
    622   def _inverse(self, y):

/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/distributions/bijector_impl.py in _call_forward(self, x, name, **kwargs)
    599       if mapping.y is not None:
    600         return mapping.y
--> 601       mapping = mapping.merge(y=self._forward(x, **kwargs))
    602       self._cache(mapping)
    603       return mapping.y

/usr/local/lib/python3.6/dist-packages/tensorflow/contrib/distributions/python/ops/bijectors/masked_autoregressive.py in _forward(self, x)
    245     y0 = array_ops.zeros_like(x, name="y0")
    246     # call the template once to ensure creation
--> 247     _ = self._shift_and_log_scale_fn(y0)
    248     def _loop_body(index, y0):
    249       """While-loop body for autoregression calculation."""

/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/template.py in __call__(self, *args, **kwargs)
    358           custom_getter=self._custom_getter) as vs:
    359         self._variable_scope = vs
--> 360         result = self._call_func(args, kwargs)
    361         return result
    362

/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/template.py in _call_func(self, args, kwargs)
    300       trainable_at_start = len(
    301           ops.get_collection(ops.GraphKeys.TRAINABLE_VARIABLES))
--> 302       result = self._func(*args, **kwargs)
    303
    304       if self._variables_created:

/usr/local/lib/python3.6/dist-packages/tensorflow/contrib/distributions/python/ops/bijectors/masked_autoregressive.py in _fn(x)
    478             activation=activation,
    479             *args,
--> 480             **kwargs)
    481       x = masked_dense(
    482           inputs=x,

/usr/local/lib/python3.6/dist-packages/tensorflow/contrib/distributions/python/ops/bijectors/masked_autoregressive.py in masked_dense(inputs, units, num_blocks, exclusive, kernel_initializer, reuse, name, *args, **kwargs)
    386         *args,
    387         **kwargs)
--> 388     return layer.apply(inputs)
    389
    390

/usr/local/lib/python3.6/dist-packages/tensorflow/python/layers/base.py in apply(self, inputs, *args, **kwargs)
    807       Output tensor(s).
    808     """
--> 809     return self.__call__(inputs, *args, **kwargs)
    810
    811   def _add_inbound_node(self,

/usr/local/lib/python3.6/dist-packages/tensorflow/python/layers/base.py in __call__(self, inputs, *args, **kwargs)
    671
    672           # Check input assumptions set before layer building, e.g. input rank.
--> 673           self._assert_input_compatibility(inputs)
    674           if input_list and self._dtype is None:
    675             try:

/usr/local/lib/python3.6/dist-packages/tensorflow/python/layers/base.py in _assert_input_compatibility(self, inputs)
   1195                            ', found ndim=' + str(ndim) +
   1196                            '. Full shape received: ' +
-> 1197                            str(x.get_shape().as_list()))
   1198       # Check dtype.
   1199       if spec.dtype is not None:

ValueError: Input 0 of layer dense_1 is incompatible with the layer: : expected min_ndim=2, found ndim=1. Full shape received: [5]

originally defined at:
  File "<ipython-input-3-646c58f4e818>", line 10, in <module>
    hidden_layers=[512,512])),
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/contrib/distributions/python/ops/bijectors/masked_autoregressive.py", line 499, in masked_autoregressive_default_template
    "masked_autoregressive_default_template", _fn)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/template.py", line 152, in make_template
    **kwargs)

edit: fixed link to TF doc

It looks like changing the base distribution to have shape [1,1] eliminates the exception:
distribution=tfd.Normal(loc=[[0.]], scale=[[1.]]).
I feel silly realising this only now but it seems the general semantics of tf.layers expects the first dimension of inputs to be batch_size. If this is the case, may I suggest that this could be made clearer in the tf.layers documentation and/or reflected in the tf.contrib.distributions examples?

@jvdillon @langmore @ebrevdo : Mind taking a look?

Thanks for reporting! Ill take a look ASAP.

Nagging Assignees @jvdillon, @ebrevdo: It has been 15 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 44 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Any updates on this? I am having the same issue.

Nagging Assignees @jvdillon, @ebrevdo: It has been 72 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 87 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 102 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 119 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 133 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 148 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 163 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 178 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 193 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 223 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 238 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @jvdillon, @ebrevdo: It has been 253 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Fixed by https://github.com/tensorflow/probability/commit/50f38f3b0184c1a441921fb7826d9c76672ca44f. Switch over to the bijector in that repository for the fix.


Video Optimization: 3P Media not loading with cross-origin isolation

Bug Description
This is a follow-up to #6875 .
With these new headers, 3P media are no longer loaded due to missing crossorigin attributes.
Expected Behaviour
All 3P media (images, videos, GIFs) should load just fine
Steps to Reproduce

Enable video optimization
Go to 3P media tab
See console errors

Screenshots

Additional Context

Plugin Version: 1.6.0-alpha
WordPress Version: 5.7
Operating System: macOS
Browser: Chrome

Do not alter or remove anything below. The following sections will be managed by moderators only.
Acceptance Criteria
All 3P media (images, videos, GIFs) should load just fine when cross-origin isolation is enabled.
Implementation Brief

Verified in QA


Add config helpers

Adds config helpers for webconsole, service serving certs, and eventually origin
Adds serviceability for image-registry, webconsole, service serving cert, and origin.
@openshift/sig-master

comments addressed


Support for GIFs

Thanks for an amazing repo! I've tried six other repos and yours is the only one that works flawlessly out of the box.
I was hoping because this builds libvips from source that this Sharp has GIF support in addition to HEIC support. It appears it doesn't as it returns the following error:

GIF output requires libvips with support for ImageMagick

I see a package giflib-devel is installed. What can I amend to have GIF support?

Glad to hear that it works for you as well.
It sounds like sharp is adding gif support in the next release: https://github.com/lovell/sharp/issues/3013
It sounds like it is a bigger undertaking and involves some API changes as well. So I'd probably wait until that is released and then update this repo accordingly.
If you need support sooner your best bet is probably to monitor the development in the sharp repo and merge the changes related to gif into this repo.

Hi, I've had the same issue, and https://github.com/zoellner/sharp-heic-lambda-layer/pull/12, which upgrades sharp, worked for me out of the box


Add overview page with signup and waitlist options

Fixes

https://issues.redhat.com/browse/HAC-2695

Description

Added new overview page with signup and waitlist options.
Cleaned up old deprecated console extensions and organised them.

Type of change

[x] Feature

Screen shots / Gifs for design review

https://user-images.githubusercontent.com/6041994/216279659-b712d900-545b-443f-b8f8-5a7ae715c030.mov
Browser conformance:

[x] Chrome
[ ] Firefox
[ ] Safari
[ ] Edge

This looks great to me from the visual + UX design sides!

This looks great to me from the visual + UX design sides! Only thing to check is just to make sure that the text styling for the 'Get started with CI/CD' header uses what the other overview pages uses (like App + Data Services overview for example: https://console.redhat.com/application-services/overview)

@maryshak1996 Updated the title to have the same heading level as other overview page.

/retest

Not sure if it's important, but the last 2 icons aren't scaling well for small window sizes

This is happening due to extra text content on the right. Added min width and height properties for it.

/lgtm

/retest


_WD_ElementActionEx() refactoring

This draft PR is related to:
https://github.com/Danp2/WebDriver/issues/120

@Danp2  what you think so far about this PR ?

Thus far, my opinion hasn't changed from here. Looking at the existing code, I do see where there could be some efficiencies by adding something like this:
Func __WD_BuildButtonAction($iButton, $sAction)
	Return ',{"button": ' & $iButton & ', "type": "' & $sAction & '"}'
EndFunc

as you add here: https://github.com/Danp2/WebDriver/pull/132
__WD_JsonElement
I would propose to change
__WD_BuildButtonAction
to
__WD_JsonButtonAction
or something like this.
What do you think about it ?

@Danp2  , @TheDcoder and @seadoggie01  please check all this JSON string reformating provided in this PR.

With this example:
#include <WinAPIFiles.au3>
#include "..\..\wd_helper.au3"
#include "..\..\wd_capabilities.au3"
;~ #include "Z:\!!!_SVN_AU3\UDF_Forum\Other_Members\Official_AutoIt_Forum\WebDriver\wd_helper.au3"

_Example()

Func _Example()

	Local $sDesiredCapabilities = SetupChrome()
	_WD_Startup()
	If @error <> $_WD_ERROR_Success Then Return
	Local $sSession = _WD_CreateSession($sDesiredCapabilities)
	_WD_Navigate($sSession, 'https://www.google.com')
	MsgBox(0, "", 'Before click - manually accept all stuff')
	Local $sElement = _WD_FindElement($sSession, $_WD_LOCATOR_ByXPath, '//img[@class="lnXdpd"]')
	_WD_ElementActionEx($sSession, $sElement, 'CLICKANDHOLD', Default, Default, 1, 5000)
EndFunc   ;==>_Example

Func SetupChrome()
	_WD_UpdateDriver('chrome')
	_WD_Option('Driver', 'chromedriver.exe')
	_WD_Option('Port', 9515)
	_WD_Option('DriverParams', '--verbose --log-path="' & @ScriptDir & '\chrome.log"')

;~ 	Local $sDesiredCapabilities = '{"capabilities": {"alwaysMatch": {"goog:chromeOptions": {"w3c": true, "excludeSwitches": [ "enable-automation"]}}}}'
	_WD_CapabilitiesStartup()
	_WD_CapabilitiesAdd('alwaysMatch', 'chrome')
	_WD_CapabilitiesAdd('w3c', True)
	_WD_CapabilitiesAdd('excludeSwitches', 'enable-automation')
	_WD_CapabilitiesDump(@ScriptLineNumber) ; dump current Capabilities setting to console - only for testing in this demo
	Local $sDesiredCapabilities = _WD_CapabilitiesGet()
	Return $sDesiredCapabilities
EndFunc   ;==>SetupChrome

I have such results:
{
	"actions": [

		{
			"id": "hover"
			,"type": "pointer"
			,"parameters": {"pointerType": "mouse"}
			,"actions": [
				{
					"type": "pointerMove"
					,"duration": 100
					,"x": 0
					,"y": 0
 					,"origin": {
 						"ELEMENT": "783b4a02-0cf1-44cf-b241-42a520ec5c09"
 						,"element-6066-11e4-a52e-4f735466cecf": "783b4a02-0cf1-44cf-b241-42a520ec5c09"
 					}
				}
,{
	"button": 1
	,"type": "pointerDown"
}
, {
	"type": "pause"
	,"duration": 5000
}
,{
	"button": 1
	,"type": "pointerUp"
}
			]
		}

	]
}

and as single line
{"actions": [{"id": "hover","type": "pointer","parameters": {"pointerType": "mouse"},"actions": [{"type": "pointerMove","duration": 100,"x": 0,"y": 0 ,"origin": { "ELEMENT": "783b4a02-0cf1-44cf-b241-42a520ec5c09" ,"element-6066-11e4-a52e-4f735466cecf": "783b4a02-0cf1-44cf-b241-42a520ec5c09" }},{"button": 1,"type": "pointerDown"}, {"type": "pause","duration": 5000},{"button": 1,"type": "pointerUp"}]}]}

@Danp2 , @TheDcoder and @seadoggie01 please check all this JSON string reformating provided in this PR.

I am not familiar with the Action API so I don't think I am in a position to judge the code.
I would however like to mention the possibility of using JSON UDF to generate the string for actions instead of hardcoding it and using StringFormat on it. One potential issue with the current approach is that it doesn't escape values, which may or may not be fatal in our use case.
That's all the feedback I have for now, best of luck!

@TheDcoder Thanks for the feedback. I've had the same thought about using the JSON functions to build the string, but it's not something that I've pursued thus far.

One potential issue with the current approach is that it doesn't escape values, which may or may not be fatal in our use case.

Do not understand it doesn't escape values.
Please elaborate or show examples.

I would however like to mention the possibility of using JSON UDF to generate the string for actions instead of hardcoding it and using StringFormat on it.

My aproach is that _WD_ElementActionEx will be used in huge loops, and will need to be fast.
IMHO when we use JSON UDF will slow down this _WD_ElementActionEx .

Do not understand it doesn't escape values.

https://www.tutorialspoint.com/json_simple/json_simple_escape_characters.htm
We have existing function __WD_EscapeString that can be used for this if needed.


RFC: .wranglerignore

The Problem
There are static assets directories that may contain lots of content that doesn't need to be uploaded to KV (and likely will trigger KV value size limits). This includes, but is not limited to, things like node_modules/ and hidden files/directories. Users should be able to specify paths (in the vein of .gitignore) that do not get uploaded to KV.
We want to make sure our ignored paths are explicit to the user; this is why we ensure that the ones we prescribe by default are put into the .wranglerignore file. This .wranglerignore file is respected even if it is in a subdirectory, similar to .gitignore.
The Solution
We will introduce support for .wranglerignore files. These files will be automatically generated with wrangler init and wrangler generate and placed in the same directory (pwd) as wrangler.toml. By default, it will include node_modules and .*.
These files will be parsed and used exactly like .gitignore whenever bucket upload_files() is called. The https://docs.rs/ignore/0.4.10/ignore crate will help us a lot here :)

where is it generated? in the root of the directory?

Yes! :D It is intended to coexist in the same directory as wrangler.toml.

+1 on this implementation and the crate
I do think that the .wignore should be cascaded like .gitignore is - that is to say, if I have a bucket ./public, I would want wrangler to respect a .wignore inside ./public

Have you considered a configuration in wrangler.toml?
I'm concerned about the name, since Wrangler doesn't only upload files but it's a "building tool", some users might be confused by .wranglerignore ignoring files from building?
Often, with static site generator, the useful website end up in a ./dist directory or similar. If we had a inclusion list instead of an exlusion list, I would just say upload everything in ./dist/**.
I don't agree with the node_modules default. It has a meaning in JavaScript (even restricted to npm) but any other language is free to use it. Also, similar to how bower worked, some people might want to upload (dependend) node_modules. And not to mention people using node_modules as a module system hack for their source files.

Upon discussing this further with @ashleygwilliams, we've decided to get rid of the .wranglerignore file in favor of a more rust-idomatic include/exclude approach like the one used by cargo: https://doc.rust-lang.org/cargo/reference/manifest.html#the-exclude-and-include-fields-optional
This approach would become part of the [site] section of wrangler.toml, which would have two new fields, exclude and include. If both are present, wrangler will use include only (same as cargo).
The benefits of this approach are that

Wrangler users will have one fewer file to deal with (no .wranglerignore)
We can constrain this ignore functionality to just Workers Sites, the only workers application that would use this ignore functionality
The coupling between Workers sites and include/exclude would neatly be represented in wrangler.toml.

This implementation should be readily doable with https://docs.rs/ignore/0.4.10/ignore/overrides/struct.OverrideBuilder.html. What do folks think?

I like it. What does this mean for bucket?

@EverlastingBugstopper these rules will be used to include/exclude uploading files from the bucket directory :)

yeah that makes sense. +1 on this :)
only reason i was asking was because i can see a world where people have assets scattered over a bunch of different directories with no clear bucket. but they could just set bucket to ./ and include exclude whatever they want

^ yep!!

I prefer the new version of your RFC, thanks for the update!

I have a feature request. I would be useful to have a debug mode (cli flag) when uploading the site. That way, the user could see the uploaded files and those that actually should be ignore instead.

TBH I prefer the .wranglerignore because it aligns more with what people are used to ( .npmignore .gitingore etc..) I think the less specialized config we put in the .toml file the better DX

Hey @xtuc we've got an issue for that exact feature! https://github.com/cloudflare/wrangler/issues/657

@victoriabernard92 that is a good point-- though I feel like we mostly have consensus on the include/exclude approach, I still want to make sure we fold you into the consensus. What I'm going to do is keep a branch with the original wranglerignore functionality and build out another branch with the suggested include/exclude approach above, and we can try both out and decide which one feels best :)

Alright y'all! We have two candidates:

.wranglerignore #720
include/exclude in wrangler.toml #760

I lean towards #760 for the reasons stated above.

Definitely a fan of option 2.

my preference is include/exclude in the toml specifically because it makes it very clear what feature of wrangler it is relevant to.

We have decided to use option 2.

Just for the record, I prefer option 2 as well :+1:


Provide Enumerable#zip as convenience accessor to Iterator#zip

Maybe i'm missing something, but why .zip is a method of Array? Exactly same code works (if moved to Enumerable) for Tuples and other Enumerable objects, and zip is a part of Enumerable in Ruby library.

I would agree it is missing in enumerable.
But I wouldn't use the same code, because it access the other array elements by index so the cost would be quadratic instead of lineal.
Copying the second enumerable in an array isn't a nice solution.
So you are left to use Iterator#zip method that can be used in a lazy fashion.
Maybe we are just needing a Enumerable#zip that will use the Iterator#zip for convenience.

It's what @bcardiff says. To implement zip you need to iterate two enumerables at once, so you need external iteration, but Enumerable only provides internal iteration. This is why there's Iterator#zip.
You moved it to Enumerable and it worked with Tuple, but try to see if it works by zipping two Ranges and you'll notice it doesn't work because you can't index a range with #[]. So as for the original issue ("move zip to Enuerable"), I don't think there's much that can be done.

Well, now i see the problem. Perhaps it is possible to introduce module that represents objects with indexed acess and move methods like Array#zip or Array#sample there, but this looks like unnecessary complication, Iterator#zip is enough for most cases.

I think having a convenience method there is a great idea and in spirit of the original request, I too the liberty to change the proposal accordingly.

Since #3725 we have zip in Indexable, which is the most generic way to define it. So I'm closing this.


chore: added github action to auto deploy built react library

Description

added a github action to build and push react library

@soulsam480 their tests are failing


feat(clustering) handle removal of fields on control plane

Backporting this from EE. Special handling of vault-auth plugin in compatibility check is not backported
as it's a EE plugin.
Reorganize the code a bit so it can be unit tested.
The next step is to use a script like https://gist.github.com/fffonion/4c0d3b78bed66fef41010ea78d5ff7cb to generate removal_fields

I've had several discussions with @mikefero on this, and we agreed it would be better to not have plugin specific details in clustering.lua, it should live with the plugins itself.
Here's some "line-of-thought" code that shows what we discussed: https://github.com/Kong/kong/compare/plugin_versions?expand=1 (the method at the bottom should probably live in clustering.lua and not be on a per-plugin basis btw)
imo we should implement something like that in CE and then replace the implementation in EE, instead of backporting the EE solution to CE. My 2cts.

(also: the conversions can be more complex than just adding/removing fields, we should be able to handle that, as in this example)

@Tieske I think that approach makes sense to me. Just to double check, the "schema_conversion" code will be called
on CP instead of DP correct?
Also as there're multiple approachs to handle this "removed fields" knowledge, i would suggest to pause the effort
to make the removed fields list being generated, and go with the approach EE is working on. How do you think @bungle ?

Just to double check, the "schema_conversion" code will be called on CP instead of DP correct?

yes. The DP being the lower version, would not have the knowledge to update it. Just thinking out loud; should we be adding this to the migrations.lua file maybe? serves a similar purpose, and also is CP side only.

@Tieske I would say probably not migrations.lua. I'm actualy thinking something not Lua but descriptive, like json or yaml. One reason is to make it possible share between different CPs, and also to limit developer from writing
over-complicated or too flexible conversions. We can discuss more detail on the implementation once Harry have the version compat ADR ready.


Data Type - Properties of a column, when showing Data Type, not all text is visible

Description
When looking at Properties of a column, in case of an enum field that has many entries, they are not all visible due to the right side of the screen overlapping the fields in the left part, as can be seen on the uploaded screenshot.
It is possible to click on the field and move the cursor with the keys all the way to the end of the string in the field, but it doesn't scroll into view, since I am guessing it's an overlap of the right side.

DBeaver Version
23.0.5
Operating System
macOS Ventura 13.3.1 (a)
Database and driver
MySQL 8
Steps to reproduce
No response
Additional context
No response

Thank you for bug report.
It's duplicate of #19202, so I'm closing this issue.
You can vote under the #19202 by adding some emoji under the issue description


Gpt4o

Tích hợp gpt4o vào dialoqbase?

GPT-4o will be added in the Friday/Saturday update.

Ok! Great work!

Could I use it!?

Not yet, but it’s currently in the next branch. We need to do some testing before releasing the new version

Ok thanks ad

Hey, GPT-4o is now available. I'm closing this issue. Let me know if you have any issues or feature suggestions. Thanks

I am currently using gpt3.5 for free after raising gpt4o when the error occurred. Do I need to upgrade to the plus version of CHATGPT no admin?

What is the error that occurred? Can you share the logs if possible? Also, please note that the OpenAI API and ChatGPT are two different products. Upgrading to ChatGPT Pro won't give you access to the API

Error: "There was an error processing your request."
When upgrading to gpt4o, do I have to change the OPENAI API or do I have to pay an additional fee?

Every body! Who'd test gpt4o success?


add pgbackrest

@carlcsaposs-canonical, do you know why pgbackrest is needed in this container image? I think it's needed only in the PostgreSQL container image.
I understood that the motivation for this PR was to synchronise with launchpad, and I saw that it was changed one day after I made a change on the PostgreSQL container image, but I don't know why the change was made on the PgBouncer container image.
Do you have additional context about why it's needed to add this package to this specific container image?

@marceloneppel I have no additional context.
I only saw that the commit was on launchpad & wondered if it should be cherry-picked onto 67bcca7. (it appears that the current OCI image for pgbouncer includes pgbackrest).
Should I try updating the image without the pgbackrest commit?

Let's ask @delgod next week if was him that asked Paulo to add pgbackrest to pgbouncer container. I saw that there is an option to do a remote backup using pgbackrest, but I don't think the pgbouncer server would be a candidate for a backup server (the one that asks for and stores the remote backup).
We probably will remove pgbackrest from this container image, but let's get the answer for the above question first.

Is it okay to leave the OCI image outdated in the meantime?

@carlcsaposs-canonical, I checked again my discussion with Paulo at the time of the commit, and I saw that we were talking about pgbouncer rocks image and also about adding pgbackrest to the postgresql container image, so we mixed those topics and that caused pgbouncer to be incorrectly added to the pgbouncer container image. So, now, you can remove pgbackrest from the image (it's not needed on pgbouncer)


icp_sal_userStartMultiProcess() in a multi-threaded app ?

Hi,
This is more of a QAT sharing related query when using the QAT crypto engine in a multi-threaded process.
Would like to get an opinion on the following:
a.  The question is for a multi-threaded process. Would like to create multiple (atleast a couple)
user-defined sections in the QAT config to share across threads. For example: Thread-A
will use the QAT (for SSL - using the crypto engine), Thread-B will also need to attach/init to
QAT for a different purpose (maps to "User-Proc-Section-B" in QAT config).
b.  I am wondering if there is a procedure to invoke "icp_sal_userStartMultiProcess()" from two
threads and get them to init two different sections ("User-Proc-Section-A" and "User-Proc-
Section-B) in the QAT config ?
c. My observation so far has been the following, QAT initialization for the process occurs on the first
invocation of "icp_sal_userStartMultiProcess", the second invocation (from another thread) does
not fail but it actually is more of a no-op. The initialization of QAT instances etc has already been
done by the first call to "icp_sal_userStartMultiProcess", hence the second call does not read any
instances or config from the QAT config file.
Given the above, it looks like the only approach to share the QAT in a process is to initialize once (icp_sal_userStartMultiProcess) for the process (maybe in main thread) and then share the instances across threads.
Appreciate any pointers. Thanks.
--
BR,
nanayak

Hi nanayak
As an initial response I would refer you to https://01.org/sites/default/files/downloads//336210-012-intel-qat-swpg.pdf document pages 48, sction <IP_ADDRESS> icp_sal_userStart on page 72, page 74 section <IP_ADDRESS> icp_sal_getDevVersionInfo in which the function icp_sal_userStartMultiProcess is discussed.  I can only refer you to the QAT driver team rather than QAT engine if you have further queries about this function.
Regards,
paulturx

Hi paulturx,
Thanks for response! I did check the sections mentioned, however looks like I will need to get in touch with the driver team for specifics. Do you know anyone in the driver team who could provide an authoritative feedback ?
--
Thanks & Regards,
nanayak

Hi nanayak
We've emailed one of our QAT driver developers.  He has come back with the following response pasted below.  Please take a look and if there are any further queries please get back to us and we will forward your issue to another QAT driver engineer:-
"If they have 2 different process name in config say SSL & SSL1 then those two process can be started and used in two different threads or as two different process."
Regards,
paulturx

Hi nanayak
Our QAT driver developer has come back with some additional information.  He refers you to section 4.5 of the above document, i.e., https://01.org/sites/default/files/downloads//336210-012-intel-qat-swpg.pdf, in which it has details about 2 user space sections SSL and IPSEC.  Although the in the document these are 2 separate processes, our engineer confirms that they can be threads instead.  I hope this helps.
Regards,
paulturx

Thanks paulturx for all the information! Will re-verify and get back.


🐛 Bug Report: It creates new To do list on hitting enter event if no input is provided.

👟 Reproduction steps
After logging in, I created a new To do. Then again I focus the input field and hit enter and created a new empty To do which was unexpected.
👍 Expected behavior
It should show pop up that ask user for input.
👎 Actual Behavior
It creates new empty To do list element.
🎲 Appwrite version
Version 0.10.x
💻 Operating system
Windows
🧱 Your Environment
No response
👀 Have you spent some time to check if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Hey can you assign this issue to me??

Hi, yes it does create an empty list.
This is a demo, hence, edge cases were not mentioned very strictly. @dubey0613 sure, you can go ahead with working on this.

Hi @dubey0613 , any update on this? please let me know if I can help you.

Hi @joeyouss I was learning about appwrite and docker that's why its taking so long!
Would update you soon!

Sure, no problem

Hi, @joeyouss
Is this issue resolved?
I can work on this issue.
Can you assign this to me?


Minor bazel definition bug with building the hands example/solution from source

Version Information
Pulling from the following commit from master, which is the latest commit on that branch today.
Problem Description and Workaround
On Ubuntu 20.04, I have set up to build the hands solution from source, by following here ― https://google.github.io/mediapipe/getting_started/cpp.html#building-c-command-line-example-apps
I have made the modifications to the build files WORKSPACE and to third_parties/open_cv_linux.BUILD for using OpenCV 4.
After having succeeding in building the hello world dummy solution (using the instructions from here), I encountered trouble building the hands solution.
As long as the following build command is supposed to work when the working directory is the project top level directory:
bazel build -c opt --define MEDIAPIPE_DISABLE_GPU=1 mediapipe/examples/desktop/hand_tracking:hand_tracking_cpu

Then it may seem as if the following line is missing in the build file opencv_linux.BUILD:
package(default_visibility = ["//visibility:public"])

I have added it myself, which enables the build to proceed. Issue solved. Looks like an inadvertent omission in the source code.
How to Handle missing OpenCV header file when building examples from source
The remainder of this post is just helpful if like me, anyone built and installed OpenCV from source while forgetting to build it with OpenCV contrib. Building some MediaPipe examples/solutions will require having OpenCV built & installed with its contrib codebase, so that they will find some contrib code which they require for their own complication.
ERROR: mediapipe/examples/desktop/BUILD:38:11: C++ compilation of rule '//mediapipe/examples/desktop:demo_run_graph_main' failed (Exit 1): gcc failed: error executing command /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections ... (remaining 61 argument(s) skipped)

Use --sandbox_debug to see verbose messages from the sandbox gcc failed: error executing command /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections ... (remaining 61 argument(s) skipped)

Use --sandbox_debug to see verbose messages from the sandbox
In file included from mediapipe/examples/desktop/demo_run_graph_main.cc:26:
./mediapipe/framework/port/opencv_video_inc.h:88:10: fatal error: opencv2/optflow.hpp: No such file or directory
   88 | #include <opencv2/optflow.hpp>
      |          ^~~~~~~~~~~~~~~~~~~~~
compilation terminated.

This is after successfully building and installing OpenCV 4.5.4 from source, optflow.hpp is simply not part of the OpenCV basic build.
The thing is that OpenCV (version 4.5.4 and like other versions too) simply doesn't have/install the particular header file optflow.hpp, it rather installs as part of OpenCV's contrib code repository. You just need to build OpenCV along with its contrib codebase. The build command for that is specified in the online documentation. This will enable building the above MediaPipe example as intended, give or take some standard make/bazel clean commands.
Disclaimer: I ended up building OpenCV 4.2.0, after seeing that it is the recommended (?) version for my version of Ubuntu as per Mediapipe docs here.
HTH.

Hi @matanster, You can find some help from this https://github.com/google/mediapipe/issues/970#issuecomment-667219458

Sure thanks. Anyway, I think the bazel file visibility omission might be a small newly introduced build bug, or I can't figure why it is so sensible to add it as a way for enabling the build of the example hands pipeline from above.
package(default_visibility = ["//visibility:public"])


Add SDIFF support

SDIFF Returns the members of the set resulting from the difference between the first set and all the successive sets.
key1 = {a,b,c,d}
key2 = {c}
key3 = {a,c,e}
SDIFF key1 key2 key3 = {b,d}

Test:
$redisMock->sadd('key1', 'a', 'b', 'c', 'd');
$redisMock->sadd('key2', 'c');
$redisMock->sadd('key3', 'a', 'c', 'e');

$this->assert
    ->array($redisMock->sdiff('key1', 'key2', 'key3'))
    ->isEqualTo(['b', 'd']);

v4.3.0