Source 'govuk_tech_docs' gem via RubyGems

Context
govuk_tech_docs gem was pointing to a repository branch, however install of the docs fails.
Changes proposed in this pull request
Source govuk_tech_docs gem via RubyGems
Guidance to review
Reinstall as per the docs guidance
Checklist

[ ] Make sure all information from the Trello card is in here
[ ] Attach to Trello card
[x] Rebased master
[x] Cleaned commit history
[x] Tested by running locally

 Fix API Docs install


Document method for exporting audit logs

Is your feature request related to a problem? Please describe.
I've implemented bank-vaults in a test environment and it does most of what I need to run Vault but exporting the audit logs to e.g. S3 is a challenge.  I found a reference to a built-in fluentd sidecar but setting FluentDEnabled: true in the spec didn't seem to have any effect (I didn't find a fluentd container in my pod afterward) nor was it clear how I could configure fluentd.
Describe the solution you'd like
I'd like to see audit logging covered as a topic in the documentation including at least one tested method of exporting audit logs from the pod.

Minor new update : https://github.com/banzaicloud/bank-vaults/pull/1662


[glyphsets] deprecated IJ/ij in GF_glyphsets

Since we decided to deprecate the digraph IJ, and still waiting for #109, we could already remove it from the glyphset so we don't have a fail in fontbakery if a font is missing it.

@RosaWagner Would it be better to keep /IJ/ij or to add /I_J/i_j, or do neither and only remove /IJ/ij?
Dutch orthography doesn’t require the character IJ (U+0132, U+0133) but:

a very few texts do use it, for example the in the DBNL corpus with 0.25 per million words or the Wortschatz Dutch corpus with 0.52, which kind of shows it’s OK to remove it.
in some styles (titling, display, signage or handwritten styles) it is nice to have a discretionary ligature or stylistic variant for the digraph I+J, which would mean having /I_J/i_j (or rather /I_J.dlig/i_j.dlig).

If either is kept or added there should also be something for /Iacute_J_acutecomb/iacute_j_acutecomb (or rather /Iacute_J_acutecomb.dlig/iacute_j_acutecomb.dlig).


Handle non-UTF8 data

I'd like to start reading some binary newsgroups and I'm finding that the code breaks because it assumes all strings are UTF8. We should use Vec to model the incoming data.

@xrl I would be happy to take pull requests for changes to make the library more usable.

You got it, take a look at the various things I've done over the intervening 18 months #10


getinode fails to build (at least on ubuntu-based distros)

make: Entering directory '/home/lookris/42FileChecker/srcs/get_inode'
main.c: In function ‘main’:
main.c:34:13: error: format ‘%llu’ expects argument of type ‘long long unsigned int’, but argument 2 has type ‘__ino_t {aka long unsigned int}’ [-Werror=format=]
  printf("%llu/%s", st.st_ino, formatdate(date, st.st_mtime));
          ~~~^      ~~~~~~~~~
          %lu
cc1: all warnings being treated as errors
Makefile:19: recipe for target 'obj/main.o' failed
make: *** [obj/main.o] Error 1
make: Leaving directory '/home/lookris/42FileChecker/srcs/get_inode'

mygetinode.txt

Hello @Avatarochnik
Sorry for my late answer. And thank you for having reported your issue.
I created a PR #147 to try solving your issue using explicit cast.
Could you have a try?
cd ~/42FileChecker
git fetch origin
git checkout fix/compile-get-inode-ubuntu
cd srcs/get_inode/
make

Thank you for your help


feat: add options to skip cursor warps

Abstruct
Adds a config general:no_cursor_warps_if_focused which, if true,
allows the cursor to the cursor to stay in place if it is already in the
focused window. This can help reduce unnecessary cursor movement.
Additional changes

skip warping cursor on ZWLR_LAYER_SHELL_V1_LAYER_TOP
add binds:changeworkspace_warp_cursor, default to false.

Reason for not including in separate PR: to avoid merge conflicts.
fixes: #3266
doc: hyprwm/hyprland-wiki#340

imo a better way to deal with #3266 would be to have a config option to not force focus on the "last active window" or warp the cursor at all, and just focus on the window under the cursor (which is just the previous behavior, and honestly nobody was having an issue with it at all)
a lot of people dont like their cursor being warped around when switching workspaces at all, especially when there's also a popular keybind of mod+scroll to switch workspaces (https://github.com/hyprwm/Hyprland/blob/main/example/hyprland.conf#L158). this just makes the cursor jump around all the time when scrolling

and just focus on the window under the cursor

This will then break focusurgentorlast and focuscurrentorlast.

df51c45d7f9e4e280b959f790f7cde6c88b9b451 warpcursor targets follow_mouse == 1 only
The older iterations of changeWorkspace (commit 5a6d0e9963eaca457a1f91c5ab4c3142c145b646) still focus the window under the cursor because they call simulateMouseMovement directly or indirectly.

https://github.com/hyprwm/Hyprland/blob/5a6d0e9963eaca457a1f91c5ab4c3142c145b646/src/managers/KeybindManager.cpp#L910
https://github.com/hyprwm/Hyprland/blob/5a6d0e9963eaca457a1f91c5ab4c3142c145b646/src/managers/KeybindManager.cpp#L895C40-L895C40

If we were to remove these calls, the window under the cursor would still be focused whenever the user moves the mouse (follow_mouse == 1).
So I don't think it can be avoided, because that's what (follow_mouse == 1) does.
At best I think we could introduce an option to disable any mousewarp in changeWorkspace, but its not possible to not change focus at all if the user wants to use follow_mouse == 1.
Per wiki

0 - Cursor movement will not change focus.
1 - Cursor movement will always change focus to the window under the cursor.
2 - Cursor focus will be detached from keyboard focus. Clicking on a window will move keyboard focus to that window.
3 - Cursor focus will be completely separate from keyboard focus. Clicking on a window will not change keyboard focus.

and just focus on the window under the cursor

This will then break focusurgentorlast and focuscurrentorlast.

i am not sure how the old behavior would break those

don't warp it

Done

I think the best way to handle this is to add an extra arg to the workspace dispatcher to allow disabling the warping on same monitor changes with follow_mouse=1. (probably just disable for cursor all settings for consistency)
Should allow user to pick the intended behavior for each individual change

I don't like this approach. I'd rather deal away with the warps entirely (no config)
it was a bad idea from the start, tbh.
A better option would be to make a simulateMouseMovement that cannot change focus, only sends motion events to the current window, use that.

I don't like this approach. I'd rather deal away with the warps entirely (no config)

same thing I said here: https://github.com/hyprwm/Hyprland/issues/3205
there is no sane way to restore focus and respect follow_mouse=1

the only sane way I see is to restore focus, and just change it if the mouse moves according to follow_mouse
if you already moved the mouse you can hover on whatever you want focused :)

it was a bad idea from the start, tbh.

Removing all the warpCursor() calls would be a pretty thorough change. Hyprland has been moving the cursor to the centre of the (keyboard) focused window for some time.

Anyway the behaviour should now be the same as 5a6d0e9963eaca457a1f91c5ab4c3142c145b646 by default.
This just adds two extra config values.

I have pushed what I believe to be the best solution to this.
41e5f401c570eccc0546dcff8bfbe09af16e3ff4
b884544ee63b4c3b3b150ff69cf24c90058c2777

Updated. The rest of this MR is unrelated to workspaceChange. And on main, the mouse warp could still be triggered on currently focused window,  e.g. if a window is removed from a group but the cursor is on the rest of the group, in this case, a warp would be considered unnecessary by some.
So I will leave this open.


Make LsuPeripheralAxiLite4 extra FF stages configurable

This commit also changes the default to only buffer the return path.
It still reaches timing closure on the LiteX digilent_arty_s7.py target and reduces the pbus latency by one.

Cool thanks ^^

no worries :D


doc: installation on mac

Summary
Key Points

[ ] This is a breaking change.
[x] Documentation (new or existing) is updated.

Description

Doc about installation instructions.
A few fixes, including deleting extra whitespace and adding missing empty lines.

Related Issues
Close #372
Current Behavior
n/a
New Behavior
n/a
Screenshots
n/a
Other Information
n/a

@algobot76 Please update your branch with main to fix the ci error.
See #386 for more info.

And please delete the Pre-Checklist section at the pr comment.

A very detailed update on the English documentation. Kudos!
FYI: our name "dtm" has a conflict with brew-core, so "brew install dtm" won't work"; we have to "brew install devstream-io/devstream/dtm" even after "brew tap devstream-io/devstream".
I made the changes accordingly.


return if first_child is the target_pid

-fixing some rubocop complaints
-if first_child is the target_pid then return true

I like it!


click on match after scrolling down leads to confusing scroll to top

Happens only in 2-column view.
Steps to reproduce:

create a need that will have many matches ("What's Around")
expand it in the list
scroll down toward the end of the list
click on one of the matches

Observe that the connection view is opened on the right hand side and the list scrolls up again, and that you are now confused.
Reason: The right hand side view should not scroll together with the left hand side view, but rather fill the available vertical space (and maybe scroll its own content - but that may cause additional problems )

This is also an issue in 1-column view. Clicking on a match works fine, but when returning to the connection overview, the scrolling position is reset. This makes it very annoying to look through suggested matches.

I think this is because when our route changes angular rerenders the whole interface. During this change the dom is emptied, which resets the scroll position.
As a workaround we could remember the scroll position before initiating a route change, but I don't think we can do better than that with our current setup.

it would be nice if we could fix the position of the right side in desktop view, especially if we remember the scrollpostion of a clicked listelement, otherwise we would not notice that anything has opened on the right side (in long lists)


rake install

hi,
I tried to install it on Centos8 but no success
======
rake aborted!
LoadError: cannot load such file -- opennebula
rake/set_hooks.rake:1:in <top (required)>' /home/open/ione/Rakefile:60:in load'
/home/open/ione/Rakefile:60:in `<top (required)>'
(See full trace by running task with --trace)
OpenNebula | 6.1
Ruby | 2.5.5
Node | 16

hi,
make sure you have opennebula in gem list


runner.close() to close down the runner

Codecov Report

Merging #76 into master will increase coverage by 1.11%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master      #76      +/-   ##
==========================================
+ Coverage   95.08%   96.19%   +1.11%
==========================================
  Files          17       17
  Lines         183      184       +1
  Branches       15       15
==========================================
+ Hits          174      177       +3
+ Misses          9        7       -2

Impacted Files
Coverage Δ

packages/haste-core/src/runner.js
100% <100%> (+5.55%)
:arrow_up:

packages/haste-core/src/haste.js
80% <100%> (+0.83%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9ddab65...93e1377. Read the comment docs.


Create Empty Actors

Hi guys,
While I can find a lot of functions for manipulating existing Actors, adding components etc, I can't find anything about creating new ones. What I want to do, is to import an FBX using the functions you provide and then create and Actor from the Asset.
Thanks,
Nick

import unreal_engine as ue
editor_world = ue.get_editor_world()
new_actor = ue.actor_spawn(ue.find_class('YourClass'))

Oh, I see! I didn't know that it's called spawn. I was looking for "create" similar to unreal_engine.create_blueprint().
Just fixed the code you provided a bit, for anyone else who might have the same question.
import unreal_engine as ue
editor_world = ue.get_editor_world()
new_actor = editor_world.actor_spawn(ue.find_class('Actor'))

Thanks

@rdeioris, I wrote a piece of code and it behaves a bit and I was wondering if it's just me doing something wrong or if it's a bit buggy.
The following code, correctly imports the asset and correctly creates the actor.

The first weird thing is that the object is not displayed until I change any property in the "Details" - it's like I need to do some sort of refresh/update.
The second weird thing is that even though I change the Actor name, the editor displays the default name. When I print all the Actor names, it seems that it prints the correct name.
Last thing, if I reload the module, Unreal instantly crashes.

import unreal_engine as ue
from unreal_engine.classes import StaticMeshActor, PyFbxFactory, FbxImportUI
import os

def fbx_import(filename, asset_path):
    if os.path.exists(filename):
        actor_name = os.path.splitext(os.path.basename(filename))[0]

        editor_world = ue.get_editor_world()
        fbx_import_ui = ue.new_object(FbxImportUI)

        ue.set_fbx_import_option(fbx_import_ui)
        asset = ue.import_asset(filename, asset_path, PyFbxFactory)

        new_actor = editor_world.actor_spawn(StaticMeshActor)
        new_actor.set_name(actor_name)

        static_mesh_component = new_actor.get_property('StaticMeshComponent')
        static_mesh_component.set_property('StaticMesh', asset)

def print_actor_names():
    editor_world = ue.get_editor_world()
    for actor in editor_world.all_actors():
        ue.log(actor.get_name())

fbx_import("C:/Users/n.moutafis/Desktop/Teapot.FBX", "/Game/MyTeapot")
print_actor_names()

You can call post_edit_change() on the actor or package_is_dirty(). The name of the actor in the editor is the 'label' not the name. And it is available only in the editor. You can set/read it with set_actor_label()/get_actor_label()
Instead of reloading the module can you try simply calling ue.exec('file') ?

Hi @rdeioris, sorry for the late reply, I just wanted to make sure that I would finish the part I was working and I wouldn't have any further questions on this point.
The bit that it was crashing Unreal was the actor.set_name("name"). When I switched to just changing the label, everything returned back to normal. Couldn't use the ue.exec('file') for some reason, but thankfully, I didn't have to. If you are interested to investigate the bug with set_name and want my help, please feel free to let me know and keep the ticket open. Otherwise, the set_actor_label worked fine for me.

When I create an empty actor, I'm getting the following message and I can't change the "movable" to "static" option. Any ideas how to fix that?
parent_actor = editor_world.actor_spawn(Actor)
parent_actor.add_actor_component(SceneComponent, "DefaultSceneRoot")

Once you create a component from the low-level api (read: not from a blueprint) you can work on it only using the low level api:
from unreal_engine.enums import EComponentMobility

# can Be Static, Stationary or Movable
scene_component.Mobility =  EComponentMobility.Static

I won't pretend I understood exactly what you just said, but it worked great! Thanks :)


Same learning curve , but can't generate samples well

Hi , i also implement PixelCNN , and training same like your learning curve
But i can't generate samples from zeros very well , can someone give me some advice ?
My project here

This code also suffering same problem and I couldn't solve it yet.

But your README page , sample after 50 epoch is well enough,
I only sample few number , is it correct ?
Thanks a lot !

Facing the same issue about generating the sample images. Would it be possible to give the hyper parameters used for training the network that generated samples shown in readme page. I've tried with couple of different combinations but still its unable to generate images like them even after ~3000 epochs.


Clean up presentation.create.html code

#55

resize indent 4 to 2
clean up example text

So clean.


Updates for W3S at scale and adding architecture (that page needs work and diagram).

Preview build

Hi @non-fungible-nelson. Made a couple of changes. Could you please review?


Update release date for rendering

Contributing to the Azure SDK
Please see our CONTRIBUTING.md if you are not familiar with contributing to this repository or have questions.
For specific information about pull request etiquette and best practices, see this section.

API change check
API changes are not detected in this pull request.


Let destination namespace be None

Specify name as null in the config and it will put the interfaces outside of the namespaces.
This was surprisingly easy. Almost too easy. Please take a look and make sure I'm not doing anything disastrous. Everything seems to work on my end though, including specifying a destination namespace as normal.

I just realized I didn't fix the hooks from the destination namespace.

It's always something.

So there's no longer an issue?

Thanks for your PR. I'll test it at the weekend.

Thank you

Thank you for your contribution!

Thank you very much for your help. I see there was a little more work left to do. I apologize, I'm not much of a programmer. I hope I didn't cause you too much trouble.

No, this was perfectly fine. Just some cosmetic changes :D


Rule blocked: CORERULES-286

Links to related JIRA Tickets

https://jira.cdisc.org/projects/CORERULES/issues/CORERULES-286

Rule Information

Standard: SDTMIG
Rule ID: CG0288
Condition: TSVCDREF = 'CDISC'
Rule: TSVALCD = valid code in the  version identified in TSVCDVER

Describe the problem
This deviates from the current way of doing CT lookups given a global study ct version.
Describe the solution
When doing CT lookups, there needs to be a way to specify a specific CT version for each lookup. The CT version may or may not match the global study ct version

This would apply only to SDTM and SEND CT. The value should be received from the standard that is being validated.
TS.xlsx

@RamilCDISC can you confirm the effort estimation?

See SDTMIG 3.4 p 420

Issue validation is complete, and the acceptance criteria have been successfully met. The new feature allowing specific CT version specification for each lookup has been seamlessly integrated without impacting other engine functionalities. The attached screenshot shows two reports generated for positive and negative dataset. The negative cases are successfully identied and are available in issue details tab. The issue can now be closed with confidence.

VALIDATION SUMMARY
Validation Methodology:
The validation process incorporated rigorous testing methodologies to ensure the accuracy and reliability of the system. This included:
Unit Testing:
Unit Testing was done to verify the implementation of the Acceptance criteria. Unit tests were designed to test the made changes using edge cases. All those tests were then run using pytest to verify compliance with acceptance criteria.
Rules Engine:
The rules engine test (in core.py) functionality was utilized to run a validation to check proper working of engine when a ct version is specified
Code Review:
The code changes in the code files were reviewed and were found to be in accordance with the Acceptance criteria. Also, the code was reviewed for following:

Code Quality Evaluation
Logic and Functionality Review
Error Handling and Exception Handling Assessment
Security Considerations

Regression Testing:
Regression tests were run to validate that the changes did not affect any functionality of the overall system.
Test Execution:
The tests were executed in the following order:
Code Review: The code for all the changes files was reviewed first to check the proper implementation of the Acceptance criteria.
Unit Tests: The unit tests were run using the following command in the terminal from the root of the project
python -m pytests path/to/the/test/files
Rules Engine: The test validation was run against above mentioned rule logic and datasets, with ct version specified. The engine worked as expected..
Regression Tests: The regression tests were then run to confirm that the changes in engine did not reak any other part of the implementation
Results:
After successful running of unit, Rule Engine test, regression tests and careful validation, the issue was found to be good to close as the Acceptance criteria was fulfilled and all validations passed.
Deviations and Non-conformances:
No deviations or non-conformances were observed.
Summary of Findings:
Test Results: All tests conducted during the validation process passed successfully, indicating that the system functions as intended and meets the specified requirements. The tests covered various scenarios and edge cases, providing confidence in the system's reliability and correctness.
Unit Regression: The unit regression tests were executed, and no regressions or issues were identified. This indicates that the changes made during the development or modification of the system did not introduce any unintended side effects or break existing functionality.
Code Reviews: The code reviews conducted by both development and QA teams were completed, and no major issues or concerns were identified. The code adheres to coding standards and best practices, demonstrating good code quality, readability, and maintainability.


Redirect handling

I have a weird issue I noticed when trying out terraform-provider-minio which uses this library.
I deployed minio with the minio operator and created an ingress for it. Inside the cluster in runs on cert-manager provided TLS certificates.
  apiVersion: networking.k8s.io/v1
  kind: Ingress
  metadata:
    annotations:
      cert-manager.io/cluster-issuer: letsencrypt-production
      nginx.ingress.kubernetes.io/backend-protocol: HTTPS
    name: cdn
    namespace: minio
  spec:
    rules:
    - host: minio.stage.my.domain
       http:
         paths:
         - backend:
             service:
               name: minio
               port:
                 number: 9000
    tls:
    - hosts:
      - minio.stage.my.domain
      secretName: cdn-ingress

The weird thing is: If I use the terraform module, it can create buckets and files without problems. But as soon as I want to create users and policies I get a JSON parse error.
I dug a bit deeper and the reason is that the nginx ingress returns a "HTTP 308" with the following headers:
Connection:[keep-alive]
Content-Length:[164]
Content-Type:[text/html]
Date:[Thu, 18 Mar 2021 07:11:26 GMT]
Location:[https://minio.stage.mecodia.cloud/minio/admin/v3/add-user?accessKey=minio_user2]

The page also contains the default nginx redirect html page so parsing that JSON fails and raises an error which bubbles up to the provider.
If I do a port-forward to localhost and run the provider against localhost instead of the public domain, it can also create users/policies.
I'm now not 100% sure were to file this. It can create buckets/files so I wonder if somewhere it follows redirects and somewhere not?

Redirection is poorly handled in Go net/http - you need to open the issue there - We are not S3 client there is documented way to handle S3 calls with redirection signature v4.
Sorry, we are shorthanded at the moment on this.

Found out that it's all solved by properly configuring the protocol as mentioned in https://github.com/aminueza/terraform-provider-minio/issues/58 - sorry for the disturbance.


Calico installation on Windows server results in network configuration to change to DHCP from static after every reboot

Installing Calico on Windows server (as a prerequisite for Kubernetes installation) with the install-calico-windows.ps1 script messes up the networking after every reboot. The static network configuration on the HyperV Virtual Ethernet Adapter (vNIC) changes to DHCP resulting in receiving a different IP from the DHCP server, which renders the node completely broken from network perspective.
Expected Behavior
The interface should come up after every reboot as per it's configuration, which is static network settings in this case. It should not receive an IP address from DHCP.
Current Behavior
After Calico installation, the virtual interface loses its static network configuration, and as a result receives an IP address from DHCP server, which is not desired. If the settings are changed back to static, it only persists for that session and becomes DHCP again after every reboot.
Steps to Reproduce (for bugs)

Build a Windows server using Windows Server 2004 SAC or 20H2 SAC image (Miscrosoft's recommendation for containerized workloads)
Configure hostname, networking and other basic host-specific configurations for the server
Install Docker
Install Calico using https://docs.projectcalico.org/scripts/install-calico-windows.ps1
Reboot

Context
I am trying to configure networking using Calico as the CNI Plugin in a Windows server to be used as worker node in Kubernetes.
Your Environment

Calico version: 3.19.1
Orchestrator version: Kubernetes v1.19.11
Operating System and version: Microsoft Windows Server Standard, OS version: 10.0.19042

Hi @poulomihore , that's odd, I wonder if when we create a new vswitch with Calico that somehow the host's static networking settings aren't being applied to it as well. Did/can you confirm with ipconfig that the host had its static IP configured?

Hi @lmm, I can confirm that the host had it's static IP configured. But once/when we create a new vswitch with calico (to be more precise during CalicoNode startup), it loses it's static IP configuration and the interface gets DHCP enabled, and receives a different IP address as a result. At this point, we have to manually configure it back to its static IP settings, but again with the next reboot, the interface loses it's static settings and the same story repeats.

Thanks for confirming @poulomihore, I wonder if there's some param we're missing when creating the HNS network... I'll look into this and get back to you.

Thank you @lmm. In case it helps, I have been using the params KubeVersion, ServiceCidr, DNSServerIPs and CalicoBackend with the script install-calico-windows.ps1 for creating the HNS network.

Hi @poulomihore, sorry for the delay... so I was able to confirm this behaviour on AWS but I don't see any API knob to change that on the vNIC so I'm not sure what we can do.
This has come up before on the Calico Users slack and the workaround suggested there was to setup a reserved IP (a MAC to IP mapping) so that DHCP is still enabled but the same IP is assigned.

Thanks @lmm for checking. I wanted to note here an observation of mine. I see this occurrence of DHCP getting enabled only on Windows Server SAC releases (had tried for Windows Server 2004 SAC and 20H2 SAC), but not on Windows Server 2019 Standard image or the likes. Can you please let me know the Windows image version which you had used to replicate this behavior on AWS ?
I have set up DHCP reservation for now as the temporary fix, but wanted to check this further so that we can come up with a long term solution once we are able to isolate the root cause.

I tested this with Windows Server 2004.

Hi @lmm, Can you please help me get down to the specific point where you think this is breaking when you had tried this out ? On installing Calico, it performs a number of steps, I wanted to check which particular step/action Calico performs which seems to be related with or results in the vNIC not being able to get the static IP assigned or get DHCP enabled.
I am willing to engage in a discussion with Microsoft as well for the benefit of the community, hence wanted to dig down this working mechanism of Calico a bit deeper and come to a specific reproducer.

Hi @poulomihore, sorry for the delay - I went back and looked again and I think there might be something we should be doing with the HNS network that Calico creates... we might be missing an Ipam setting: https://github.com/microsoft/hcsshim/blob/7fa8bda4e6ba503caf0d53d0a4ee99b9a64ceed8/hcn/hcnnetwork.go#L29

Thanks @lmm for checking this. It would be really helpful if you can confirm whether we have the Ipam setting set as DHCP instead of Static on the Calico side while we are creating the HNS network. In case it helps to troubleshoot, I would like to mention here that on Windows Server 2019, we do not see this issue and the virtual interface gets configured as static. We only see this on the SAC (Windows server 2004 and 20H2 ) Server versions. If you think there can be an Ipam setting tweaked/added to help fix this, that would be great.


Create CodeOfCoduct

https://github.com/DeCenter-AI/app.decenterai.com

Code of conduct is missing, create one

https://github.com/prisma/prisma/blob/main/CODE_OF_CONDUCT.md

@RedValis can u pick this up

@Abhay-2811 i have reassigned this to @RedValis

Sure, I'll work on it

Code of Conduct added


Feature Request: Highlight Un-used imported classes

Thank you for your amazing work, It would be nice if you consider highlighting unused imported classes or even a way to remove them on file save (code formatter)

hi this is covered by: https://github.com/phpactor/phpactor/issues/1493 i might give it a try now ...

done :crossed_fingers:


docs(readme): updated README configuration section

Description
Added the missing properties to the repo's README.md.
Motivation and Context

3 properties were missing from the README.md file but were available on the official API docs.
Mentioned in #196.

Hey @christopherkade, thanks for adding this! We're currently working on a documentation overhaul, so this will likely get moved in the future. I'll still merge in now as the ETA for the doc release is up in the air. Thanks a million! :octocat:


cluster_deploy_operator: fix issues when the version is not requested

/test watsonx-serving-light

/test watsonx-serving-light

test passed, merging


Make cache key unique per username

Description
Make cache key unique per username.
This will fetch all forks again.
Already cached forks will invalidate after 10 days anyways.
Closes
Closes https://github.com/sindresorhus/refined-github/pull/2153#issuecomment-509045202
/cc @1138-4EB & @bfred-it

This by the way will lose the current cache, which will be forgotten within 10 days


brew version is old & doesn't have the leave function

took me too long to figure out but once I compared the git versus the download from brew I discovered (!@#) that the leave functionality was not there.
Looks like an update to brew is needed.

@dasJ - Is it possible to tag and release the latest version so that a pull request against HomeBrew can be made to include the latest changes? Currently master is 45 commits ahead of the v0.2.1 release

Aha, finally I found this! This made me mad, why leave scripts doesn't work. @dasJ  Would you please update the brew installation for us. Thank you!  : )

@MemoryReload I've since moved over to direnv - which I really like.

You could install the latest version via git.
https://github.com/kennethreitz/autoenv#using-git


Sql script is incorrect in tutorial

Issue moved from MicrosoftDocs/feedback#3418

Please respond to @IvanKondral.

From @IvanKondral on Monday, January 25, 2021 10:43:08 AM
Describe the bug
https://docs.microsoft.com/en-us/sql/integration-services/lesson-1-6-adding-and-configuring-the-lookup-transformations?view=sql-server-ver15
There is a wrong sql query that uses Sales.Currency which has not been described before.
Also in downloaded lesson 1 result this query is different

Issue moved from MicrosoftDocs/feedback#3418

Please respond to @welcome[bot].

From @welcome[bot] on Monday, January 25, 2021 10:43:09 AM
Thank you for creating the issue! One of our team members will get back to you shortly with additional information. If this is a product issue, please close this and contact the particular product's support instead (see https://support.microsoft.com/allproducts for the list of support websites).

@gewarren -- Genevieve, please pass this along to Ivan:

@IvanKondral -- Ivan, thank you for your feedback.  We are looking into updating this article.

@chugugrace -- Grace, please look into this issue.

After email discussion with @chugugrace, the issue is resolved in merged PR https://github.com/MicrosoftDocs/sql-docs/pull/6152. The fix should be live later today. I've responded to and closed the other pull requests that propose updates to resolve the issue.

#please-close


Output filenames cannot contain a /

Please provide a set of steps on how to reproduce the issue
$ syft --version
syft 0.62.1
$ ls -al example.json
ls: example.json: No such file or directory
$ syft docker:seiso/easy_infra:2022.11.06-ansible-eab07ab -o json --file example.json
 ✔ Loaded image
 ✔ Parsed image
 ✔ Cataloged packages      [343 packages]
$ ls -al example.json
-rw-r--r--  1 jonzeolla  staff  7879187 Nov 29 10:59 example.json
$ rm example.json
$ syft docker:seiso/easy_infra:2022.11.06-ansible-eab07ab -o json --file 'example/example.json'
 ✔ Loaded image
 ✔ Parsed image
 ✔ Cataloged packages      [343 packages]
$ ls -al example/
total 15392
drwxr-xr-x   3 jonzeolla  staff       96 Nov 29 10:57 .
drwxr-xr-x  27 jonzeolla  staff      864 Nov 29 10:59 ..
-rw-r--r--   1 jonzeolla  staff  7879195 Nov 29 10:59 example.json
$ syft docker:seiso/easy_infra:2022.11.06-ansible-eab07ab -o json --file 'example\/example.json'
 ✔ Loaded image
 ✔ Parsed image
 ✔ Cataloged packages      [343 packages]
$ ls -al example\\ # It literally made a folder called 'example\'
total 15392
drwxr-xr-x   3 jonzeolla  staff       96 Nov 29 10:59 .
drwxr-xr-x  28 jonzeolla  staff      896 Nov 29 10:59 ..
-rw-r--r--   1 jonzeolla  staff  7879197 Nov 29 10:59 example.json

What happened:
When I attempted to make an output file containing a /, instead it created a folder structure.
What you expected to happen:
I expected to be able to include a string literal / in the output file name without escaping.  As a workaround, I expected to be able to manually escape the /.
Anything else we need to know?:
Nah
Environment:

Output of syft version: syft 0.62.1
OS (e.g: cat /etc/os-release or similar): macOS 13.0.1 (22A400)

I'm not certain if this is the correct way to escape directory separators, I tried the same approach with bash redirect instead with no luck:
❯ syft alpine:latest -o json --name crazy > /tmp/example\/example.json
zsh: no such file or directory: /tmp/example/example.json
❯ syft alpine:latest -o json --name crazy > "/tmp/example\/example.json"
zsh: no such file or directory: /tmp/example\/example.json
❯ syft alpine:latest -o json --name crazy > '/tmp/example\/example.json'
zsh: no such file or directory: /tmp/example\/example.json

I think syft's behavior with creating the directory helps the user and is not a surprising result relative to the bash redirection case listed above.
I'm going to close this for now as a "wont-fix" but please feel free to comment with more thoughts in case I've mischaracterized something here.


AttributeError: 'PNet' object has no attribute 'named_parameters'

Python 3.5.2 (default, Nov 23 2017, 16:37:01)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from src import detect_faces
>>> from PIL import Image
>>> image = Image.open('images/example.png')
>>> bounding_boxes, landmarks = detect_faces(images)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
NameError: name 'images' is not defined
>>> bounding_boxes, landmarks = detect_faces(image)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/ubuntu/mtcnn/src/detector.py", line 25, in detect_faces
    pnet = PNet()
  File "/home/ubuntu/mtcnn/src/get_nets.py", line 56, in __init__
    for n, p in self.named_parameters():
  File "/usr/local/lib/python3.5/dist-packages/torch/nn/modules/module.py", line 235, in __getattr__
    return object.__getattribute__(self, name)
AttributeError: 'PNet' object has no attribute 'named_parameters'

I can see at get_nets.py line #56 the offending code, and I can see that PyTorch supports that function, so it seems a bit bizarre to me.
I have PyTorch 0.1.10 on a Jetson TX2.

Nevermind I saw that you require min version of PyTorch 0.2 and tried with 0.5 and it works fine.


Ability to override content-type for POST request

Currently, Content-Type is set as application/json; charset=utf-8 for POST requests with JSON body. Some legacy APIs only accept application/json as content-type in request headers which leads to error. There should be an option to override it.

Hello, @ashitaprasad,
can i take up this issue!

Sure @jassirr waiting for your PR.
If you have any doubt/query feel free to post it in our discord channel #foss-apidash

The encoding (charset) is compulsorily passed by http library so the exact use case described is currently not possible. But, still solving this issue helps pass custom content-type for POST requests.


Fix Zenburn inherit face bug + minor visual enhancements

Visual enhancements include company-mode, highlight-symbol, and highlight-thing

Thanks for the PR!


Update from bitly

This is to pull in all the updates from the mainline bitly owned repo.
The option skip-provider-button will be really nice. Plus HMAC signing could be nice.

@ktheory Should we keep pushing this to keep pushing this to the public kickstarter docker repo or ECR?

@talaris: LGTM! What's your recommendation for public registry vs ECR?
On Wed, Jun 22, 2016 at 3:45 PM Kyle Burckhard<EMAIL_ADDRESS>wrote:

@ktheory https://github.com/ktheory Should we keep pushing this to keep
pushing this to the public kickstarter docker repo or ECR?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/kickstarter/oauth2_proxy/pull/2#issuecomment-227855370,
or mute the thread
https://github.com/notifications/unsubscribe/AAADz6mhHA4XZnwhsagDy1jId_VF3VISks5qOZC9gaJpZM4I8JC5
.

@ktheory: Right now our only changes are to enable Docker builds, it's set as an automatic build on the docker hub. I don't see us customizing it too much more at this date so I think we can stay with the public repo for now.


build: disable copt='-g' and fix broken import for macos-x86_64

These were the most minimal set of changes that allowed me to build vere on macOS x86-64. See #131 for context. To build, I ran bazel build --clang_version="12.0.0" :urbit.

It'd be a good idea to update your macOS version - Monterey is a major version behind and I don't think we should put effort into making sure things work on old macOS versions. I'm not sure if that's the case here, but that would have been the first thing I would have done, CC: @mcevoypeter

Done!

@mcevoypeter mind giving this another review and signoff if it looks good now? I believe all previous comments were addressed.


[SPARK-45177][PS] Remove col_space parameter from to_latex

What changes were proposed in this pull request?
This PR proposes to remove col_space parameter from DataFrame.to_latex and Series.to_latex
Why are the changes needed?

Since they're also removed from Pandas 2.0.0, so we should follow.
Does this PR introduce any user-facing change?

col_space from DataFrame.to_latex and Series.to_latex has been removed as mentioned from migration guide.
How was this patch tested?

Removed the deprecated tests.
Was this patch authored or co-authored using generative AI tooling?

No

Merged to master.


Spring provider can not send tags to broker after validation

Is it currently possible to publish the current version tag of the provider after a pact file from the broker is validated?
It now defaults to 0.0.0. Seems related to #200 for gradle and #0abaf38 for the Maven-Provider. Is there something similar for the Spring-Provider?

The Spring provider support is an extension of the JUnit 4 runner. These use the Java system property pact.provider.version for the version of the provider.

Ah i see, Thanks.
Nice project!


create label* functions for pagure backend

Would be nice to be able to manipulate labels on pagure issues. i.e. get_issue_labels() add_issue_labels(), etc..
update by @lachmanfrantisek:
TODO:

[x] labels property for PagureIssue class (https://github.com/packit-service/ogr/pull/321 by @cverna )
[x] labels argument for PagureIssue.create and PagureProject.create_issue (https://github.com/packit-service/ogr/pull/321 by @cverna)
[ ] labels property for PagurePullRequest class
[ ] labels argument for PagurePullRequest.create and PagureProject.create_pr
[ ] add_label methods blocked by the PagureAPI
[ ] add tests for all of those

Thanks for the request.
We need to look into the pagure API to see if it is possible to manipulate with that via API.

cc @marusinm as I think he already tried to solve this.

I think he already tried to solve this.

Yes, we were discussing that with Marek and there is no API for manipulation with labels from what we know.

Would be nice if someone opened a request at pagure upstream and linked the issue here :)

Would be nice if someone opened a request at pagure upstream and linked the issue here :)

Any volunteer? OK, I'll create an issue. (I have a list of issues for pagure that I would like to create...;-)

There is already an issue for that:
https://pagure.io/pagure/issue/2175

thanks @lachmanfrantisek for linking the two issues

We are still blocked by the Pagure API.

We are still blocked by the Pagure API.

Looks like it's not true anymore... Nice!

I've updated the description and add the TODO-list.

Some parts are still missing.


k8s/types: fix missing deepcopy of SpecPodCIDRs in Node structure

Fixes: 47a87f838709 ("pkg/k8s: add support for multi-stack")
Signed-off-by: André Martins<EMAIL_ADDRESS>

This change is

test-me-please

Coverage decreased (-0.002%) to 44.489% when pulling c300f9dd4f07903cb2fca152b65bd9e7091f2460 on pr/fix-deep-copy into 4800e02d1f5dfbac379fa2ff9e7303ed41b7638c on master.


[string] Cleanup, reorganization, guts visitor

This includes a myriad of adjustments in preparation for small strings. These has the first half of https://github.com/apple/swift/pull/14755 in it, and this is immediately mergeable for more incremental development (and less rebasing maintenance).

@swift-ci please test


Add info about fetching credentials from IAM role

Fixes https://github.com/docker/distribution/issues/741
@stevvooe PTAL. I'm a little out of my depth. There was already advice about setting these to an empty string for one behavior, and now we have another behavior if they are completely omitted. Is that right?

Addressed feedback. I'll merge this when Netlify finishes if there isn't any more feedback.


AWS Lambda Function Integration for Chatbot Backend

Task

Integrate AWS Lambda function to securely call API through serverless function

Deliverables

JS function to call to AWS Lambda function which will call LLM API

Size Estimation: Medium (2-4 hours)

Making an API call to the serverless function from our application. The groq based llama3 model is deployed on AWS Lambda

Duplicate.


NOTICKET: fix incorrect spacing

Seem there were extra padding at the top, so the centering wasn't correct in https://github.com/LinearityGmbH/purchases-ios/pull/41

ignore the blue line, only shows container


[KYUUBI #5529][AUTHZ][FOLLOWUP] Fix Create table ut for Delta Lake does not trigger a sql operation

Why are the changes needed?
Fix bug,  Create table ut for Delta Lake does not trigger a sql operation.
How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[x] Run test locally before make a pull request

Was this patch authored or co-authored using generative AI tooling?

Thanks, merged to master

Thanks, @yaooqinn @cxzl25


Long term support for MIR software versions 2.8 or above

Hi,
I was wondering if there was going to be a long term support for MIR software version 2.7 or higher?
The current repo is for 2.3.1 or lower. Although, some of the issues for later software versions have been address in other Issues section but there might some other issues which have not yet been encountered.
Thanks

I don't have MiR software 2.8 available for testing. The newest version that I have is 2.6.
At some point in the future, I plan on upgrading our robot to 2.6 and updating this repo with all necessary changes, so that it also supports version 2.6; this should solve most problems for 2.8 as well, I believe. This is however not high priority for me, I'm swamped with other projects. Also, due to the Coronavirus pandemic, I'm working from home at the moment and don't have access to the MiR robot, so it'll have to wait until afterwards. Sorry for the inconvenience.

Let's continue the discussion in #45.


feat: [IDP]: Added the docs on Entity Refernce

Thanks for contributing to the Harness Developer Hub! Our code owners will review your submission.
Description

Please describe your changes: __________________________________
Jira/GitHub Issue numbers (if any): ______________________________
Preview links/images (Internal contributors only): __________________

PR lifecycle
We aim to merge PRs within one week or less, but delays happen sometimes.
If your PR is open longer than two weeks without any human activity, please tag a code owner in a comment.
PRs must meet these requirements to be merged:

[ ] Successful preview build.
[ ] Code owner review.
[ ] No merge conflicts.
[ ] Release notes/new features docs: Feature/version released to at least one prod environment.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://6708adbd6345d0ec5245a07a--harness-developer.netlify.app

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://670d2951d478fd445391d37c--harness-developer.netlify.app


New app: Avatars in Pixels

Description
This app generates a random pixel art character using the Avatars In Pixels API and displays it on the Tidbyt using a nice animation:

More details are provided in the README.md file.
Copilot

🤖 Generated by Copilot at 4d85165
Summary
🎨📝🚀

This pull request adds a new app called avatarsinpixels, which uses the Avatars In Pixels API to display random pixel art characters on the Tidbyt device. It includes the main app code in avatars_in_pixels.star, the app metadata in manifest.yaml, and the app documentation in README.md. The purpose of this app is to demonstrate the use of the Tidbyt API and libraries, as well as to provide a fun and colorful display option for Tidbyt users.

avatars_in_pixels
A new app for Tidbyt
Pixel art in spring

Walkthrough

Create and configure the app metadata in manifest.yaml (link)
Implement the app logic and UI in avatars_in_pixels.star (link)
Document the app and its features in README.md (link)

Thanks for the PR. If possible, it'd be great if you could use the built in cache functionality of the http module. I realize it might be tricky due to that cookie passed to the second request, but still wanted to mention it. We're hoping to minimize the use of the cache module, and possibly even remove or rescope it.

Thanks for the PR. If possible, it'd be great if you could use the built in cache functionality of the http module. I realize it might be tricky due to that cookie passed to the second request, but still wanted to mention it. We're hoping to minimize the use of the cache module, and possibly even remove or rescope it.

Thanks. I considered using the http module cache, but I preferred the old cache module since it's not scoped by installation. I know that every Tidbyt device will display the same image, but this was intentional so the avatars in pixels API is not hammered, and there's less risk of rate limiting and IP blocking.

Got it, good thinking. However, the http cache is actually not scoped by installation, but is instead shared among all users of the app. We may change the scope of cache.star in the future though, and that could become per-installation. TBD.


dapp: Introduces snackbar and replaces receiving disabled dialog

Thank you for submitting this pull request :)
Fixes #1786
Fixes #1619
Short description
Definition of Done

[x] Steps to manually test the change have been documented
[x] Acceptance criteria are met
[ ] Change has been manually tested by the reviewer (dApp)

Steps to manually test the change (dApp)

Enter the dApp
The snack bar displays on top with a message that the receiving being disabled.

@raiden-network/light-client I am guessing I can still pick up and finish this tomorrow right?

Sure, @kelsos . Thank you for this, go ahead. Also, good job so far, I've tested it as is, it's great, I'll just leave some comments about some issues, in case you haven't noticed them. Thanks

@andrevmatos sure let me know :)


Build Issue

I am following the build process, but facing an error while building the DeepSDF functionalities. A possible error is due to Pangolin. I tried building and installing various versions of it (Pangolin), but none seems to work. I am trying the building process on google colab. I am sharing the link to the gist. Can someone please look into it, and help solve the error?
Code : Colab

Hey, did you fix this issue?


add repository schedule to remind inactive repos

This is intended to start to organize which repositories are actively maintained or not.
It opens an issue on repositories that haven't been updated in 180 days to help identify organizations that are no longer maintained.

@wenzowski thank you for reviewing! I made changes based on your feedback.

This is now a +91 −3 single-feature patch, and the diff is hopefully a bit more reviewable as a result.


Separate slider value from display?

Is your feature request related to a problem? Please describe.
I just want a volume bar, but I don't want it to have numbers floating on top?
Describe the solution you'd like
The non-breaking solution would be to let value accept floating point AND empty strings.
Imho, the better solution would be to create a separate field called display(or label) that accepts a string.
(and optionally gives the value by argument, $0)
Additional context
If this doesn't end up being implemented? Please tell me how to style this.

The easier alternative here is just to add a show_label  option which you can set to false to hide the label. GTK doesn't really offer much control over the label beyond that.

uhh, why exactly is this closed? is the new option just not documented?
Although I did find a workaround. Just remeove it in css!
scale value {
	color: #77a5bf;
	font-size: 0px;
}

uhh, why exactly is this closed? is the new option just not documented?

I'm not sure myself, I checked the code and there is no show_label option added, all the code in the PR seems to be related to a step option.

There was a discussion that lead to the linked PR, got them muddled


please provide an example for pulling telemetry data

please provide an example for pulling telemetry data (MKR1000)

Added to documentation, closing issue.


.NET 6 RC2 seems to have changed some underlying JS Libraries

Problem:
RC2 must have changed the Virtualization component cause now it errors in Tests asking for the setup of a JS module (example repo showing issue below).
Bunit error message

Bunit.JSRuntimeUnhandledInvocationException : bUnit's JSInterop has not been configured to handle the call:
InvokeAsync<IJSVoidResult>("Blazor._internal.Virtualize.init", Microsoft.JSInterop.DotNetObjectReference`1[Microsoft.AspNetCore.Components.Web.Virtualization.VirtualizeJsInterop], Microsoft.AspNetCore.Components.ElementReference, Microsoft.AspNetCore.Components.ElementReference)

Configure bUnit's JSInterop to handle the call with following:
Setup<IJSVoidResult>("Blazor._internal.Virtualize.init", Microsoft.JSInterop.DotNetObjectReference`1[Microsoft.AspNetCore.Components.Web.Virtualization.VirtualizeJsInterop], Microsoft.AspNetCore.Components.ElementReference, Microsoft.AspNetCore.Components.ElementReference)

or the following, to match any arguments:
Setup("Blazor._internal.Virtualize.init", _ => true)

When I try to JSInterop.SetupVoid("Blazor._internal.Virtualize.init", _ => true); my test still doesn't work. I'll put the stack trace at the bottom.
Repoduction of Issue here:
https://github.com/thalaeg/BunitRc2Issue
Stack Trace:

BunitJSInterop.TryHandlePlannedInvocation[TValue](JSRuntimeInvocation invocation) line 84
BunitJSInterop.HandleInvocation[TValue](JSRuntimeInvocation invocation) line 69
JSRuntimeExtensions.HandleInvokeAsync[TValue](BunitJSInterop jSInterop, String identifier, Object[] args) line 14
BunitJSRuntime.InvokeAsync[TValue](String identifier, Object[] args) line 23
JSRuntimeExtensions.InvokeVoidAsync(IJSRuntime jsRuntime, String identifier, Object[] args)
VirtualizeJsInterop.InitializeAsync(ElementReference spacerBefore, ElementReference spacerAfter)
Virtualize1.OnAfterRenderAsync(Boolean firstRender) TestRenderer.AssertNoUnhandledExceptions() line 351 TestRenderer.Render[TResult](RenderFragment renderFragment, Func2 activator) line 237
TestRenderer.RenderFragment(RenderFragment renderFragment) line 55
TestContextBaseRenderExtensions.RenderInsideRenderTree(TestContextBase testContext, RenderFragment renderFragment) line 45
TestContextBaseRenderExtensions.RenderInsideRenderTree[TComponent](TestContextBase testContext, RenderFragment renderFragment) line 25
TestContext.Render[TComponent](RenderFragment renderFragment) line 70
TestContext.RenderComponent[TComponent](ComponentParameter[] parameters) line 40
MyGridTests.TestFails() line 11

Additional Notes:
RC2 also seems to fail for focusing  cause I also get this similar error (in my personal repo.. not in the example repo above)..

Setup("Blazor._internal.domWrapper.focus", _ => true)

Though I haven't isolated that one yet. Will comment on this issue if I can narrow it down.. though my current guess is that it may relate to "clicking" and/or Focusing on an ElementReference

@thalaeg thanks for reporting this.
I have pushed an update yesterday to GPR that has a fix for this. Here is a guide to get the preview version of bUnit: https://github.com/bUnit-dev/bUnit/discussions/209
I'll push a preview version of bunit to nuget.org now, it should be there in 30 minutes or so.

Awesome. Glad to hear there is a solution in the works! I will do that tomorrow and report back. Appreciate you responding so quickly.

Great. I'll close this issue then.


Retrieve height data  from LM API

I need a function that takes a position and returns the height.

I need to round every point to the closest 50meter because I only have data for every 50meters.

50*round(position/50)
rounds to closest 50meter so I then can take the elevation at that point

Have a function for this.


RSRMID: Add getRegistrationDate for Blesta 5.10.0 compatibility and bug fixes

Implemented getRegistrationDate to ensure compatibility with Blesta 5.10.0.
Fixed several bugs to improve module stability and performance.

:tada: This PR is included in version 3.7.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Making tooltip compatible with Vue 2

#3

I'm adding another PR that makes this obsolete, closing.


[SUPPORT]Flink Streaming Read hudi table which is in clustering,encounterd file not exists.

A hudi table ods_itp_tss_hudi is written by a flinksql program A  whose version is flink1.16.0-hudi13.0.
The program A's sql is :
"""
create table tss_odp_kafka_source
(
data string,
ts timestamp(3) metadata from 'timestamp',
partition int metadata from 'partition',
offset bigint metadata from 'offset'
) with (
'connector' = 'kafka',
'topic' = 'ods_vgc_itp_tss',
'value.format' = 'raw',
'scan.startup.mode' = 'group-offsets',
'properties.auto.offset.reset' = 'earliest',
'properties.bootstrap.servers' = '${kafka.servers}',
'properties.group.id' = 'g-tss-ods-hudi'
);
create table ods_itp_tss_hudi (
type string,
country string,
source string,
brand string,
version string,
vin string,
updated_date string,
etl_date string,
data string,
recv_time timestamp(3),
kafka_partition int,
kafka_offset bigint,
kafka_ts timestamp(3),
sync_date string
) partitioned by (sync_date, type)
with (
'connector' = 'hudi',
'table.type' = 'COPY_ON_WRITE',
'path' = '/hudi/ods_vgc/ods_vgc_itp_tss_rli',
'write.tasks' = '1',
'write.operation' = 'insert',
'write.task.max.size' = '512'
'clustering.schedule.enabled' = 'true',
'clustering.async.enabled' = 'true',
'clustering.delta_commits' = '6',
'clean.async.enabled'='false',
'clean.retain_commits'='1'
);
insert into ods_itp_tss_hudi
(type, country, source, brand, version, vin, updated_date, etl_date, data, recv_time, kafka_partition, kafka_offset, kafka_ts, sync_date)
select
tss.type,
tss.country,
tss.source,
tss.brand,
tss.version,
tss.vin,
tss.updated_date,
tss.etl_date,
tss.data,
to_timestamp(convert_tz(date_format(LOCALTIMESTAMP, 'yyyy-MM-dd HH:mm:ss'), 'GMT+08:00', 'UTC')) as recv_time,
kafka_partition,
kafka_offset,
kafka_ts,
sync_date
from (
select
decompress_tss(data) as tss,
to_timestamp(convert_tz(date_format(ts, 'yyyy-MM-dd HH:mm:ss'), 'GMT+08:00', 'UTC')) as kafka_ts,
partition as kafka_partition,
offset as kafka_offset,
date_format(ts, 'yyyyMMdd') as sync_date
from tss_odp_kafka_source
);
Then I started a new flink program B to streaming read the table ods_itp_tss_hudi created by program A,but i encounted the cause:
2024-04-19 03:45:27,925 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: TSS[1] -> Calc[2] -> ConstraintEnforcer[3] -> TableToDataSteam -> Filter -> Map -> Filter -> Map -> Sink: StdStreamToClickHouse (2/10) (87754f6aa528b72165577ce077304447_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from RUNNING to FAILED on container_e70_1702372395802_74102_01_000010 @ <IP_ADDRESS> (dataPort=37053).
java.io.FileNotFoundException: File does not exist: hdfs://HDFS8000151/hudi/ods_vgc/ods_vgc_itp_tss_rli/20240418/combi/7be53036-cdd9-4388-bd53-ce35edd303c3-0_0-1-0_20240419025522427.parquet
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1587) ~[hadoop-hdfs-client-3.1.2.jar:?]
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1580) ~[hadoop-hdfs-client-3.1.2.jar:?]
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) ~[hadoop-common-3.1.2.jar:?]
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1595) ~[hadoop-hdfs-client-3.1.2.jar:?]
at org.apache.parquet.hadoop.util.HadoopInputFile.fromPath(HadoopInputFile.java:39) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:469) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.hudi.table.format.cow.vector.reader.ParquetColumnarRowSplitReader.(ParquetColumnarRowSplitReader.java:130) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.hudi.table.format.cow.ParquetSplitReaderUtil.genPartColumnarRowReader(ParquetSplitReaderUtil.java:148) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.hudi.table.format.RecordIterators.getParquetRecordIterator(RecordIterators.java:56) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.hudi.table.format.cow.CopyOnWriteInputFormat.open(CopyOnWriteInputFormat.java:132) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.hudi.table.format.cow.CopyOnWriteInputFormat.open(CopyOnWriteInputFormat.java:66) ~[hudi-flink1.16-bundle-0.13.1.jar:0.13.1]
at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:84) ~[flink-dist-1.16.0.jar:1.16.0]
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110) ~[flink-dist-1.16.0.jar:1.16.0]
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:67) ~[flink-dist-1.16.0.jar:1.16.0]
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:333) ~[flink-dist-1.16.0.jar:1.16.0
The program A has configued the parameter 'clustering.schedule.enabled' = 'true' to cluster the parquet file asynchronously.
And parquets would be clusted until by 600Mb. When my program B was reading the parquet which was been clustered ,then I would met the file not exists exception.
Anyone who can help me?

You may need to tweak the clean.retain_commits option.

这个参数是没有效果的。那天我们看到，几天前的分区里面的小文件，在不停的原地滚动变更名字。我们的分区是按照本地系统时间对应的年月日来分区的。所以几天前的分区里面不会再有新的文件写入了。而那些没有被合并的小文件会不停的滚动变更文件名。一旦变更文件名，我就无法读取。
---Original---
From: "Danny @.>
Date: Thu, Apr 25, 2024 16:55 PM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [apache/hudi] [SUPPORT]Flink Streaming Read hudi table which isin clustering,encounterd file not exists. (Issue #11090)
You may need to tweak the clean.retain_commits option.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

Is it beause they are being clustered continuously? And do you already skip reading the clustered files?

i have added the parameter to skip clustering file,but it did not work.
---Original---
From: "Danny @.>
Date: Fri, Apr 26, 2024 07:50 AM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [apache/hudi] [SUPPORT]Flink Streaming Read hudi table which isin clustering,encounterd file not exists. (Issue #11090)
Is it beause they are being clustered continuously? And do you already skip reading the clustered files?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

There are some logs that reports the reader progress in the monitor operator, you can check that to see if the reader lags too much from the producer.

跟这个参数没有关系，文件不断的持续的在原地进行创建，并删除旧文件

2024年4月26日 11:11，Danny Chan @.***> 写道：
There are some logs that reports the reader progress in the monitor operator, you can check that to see if the reader lags too much from the producer.
—
Reply to this email directly, view it on GitHub https://github.com/apache/hudi/issues/11090#issuecomment-2078557010, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHH2Q2QOFHREAUGXUJIQCYTY7HAXJAVCNFSM6AAAAABGYIXP6OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANZYGU2TOMBRGA.
You are receiving this because you are subscribed to this thread.

If the job is not executing rollback repetitively, these files should be just a replacing of "COW" of files, for "COW", we create a new base file to replace the old one while the old one would be cleaned based on the cleaning configurations.

please look this pic, April 17th,we found the little files in partition 20240411 were clustered still.
And the downstream flink program read these files would met FileNOTEXTIES exception.
The upstream program enabled asynchronous compression configuration.

@codope  when will we solve this problem?

clustered still.
And the downstream flink program read these files would met FileNOTEXTIES exception.

Either clustering and compaction can be skipped in flink streaming read.

I added the skip parameter in my downstream flink program,but the same problem happend again

Would you mind addind a test to solve this problem?

We did have the tests already in the repo for clustering and compaction skipping read, can you ensure the option takes effect and increase the numbers of retained commits before cleaning with option clean.retain_commits.

I did not increase the clean.retain_commits,the clean.retain_commits was 1.
By the way,how to configue the clean.async.enabled https://hudi.apache.org/docs/configurations#cleanasyncenabled, true or false?

2024年5月7日 10:14，Danny Chan @.***> 写道：
We did have the tests already in the repo for clustering and compaction skipping read, can you ensure the option takes effect and increase the numbers of retained commits before cleaning with option clean.retain_commits.
—
Reply to this email directly, view it on GitHub https://github.com/apache/hudi/issues/11090#issuecomment-2097276769, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHH2Q2WGNRNJRN7XAT2YIJDZBA2HJAVCNFSM6AAAAABGYIXP6OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJXGI3TMNZWHE.
You are receiving this because you are subscribed to this thread.

小文件会在后台不停的被合并，直到600M为止。你确定我们这样做，会不会导致下游程序读数据少读，重复读呢？

2024年5月7日 10:14，Danny Chan @.***> 写道：
We did have the tests already in the repo for clustering and compaction skipping read, can you ensure the option takes effect and increase the numbers of retained commits before cleaning with option clean.retain_commits.
—
Reply to this email directly, view it on GitHub https://github.com/apache/hudi/issues/11090#issuecomment-2097276769, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHH2Q2WGNRNJRN7XAT2YIJDZBA2HJAVCNFSM6AAAAABGYIXP6OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJXGI3TMNZWHE.
You are receiving this because you are subscribed to this thread.

Small files are continuously merged in the background until 600M. Are you sure that if we do this, will the downstream program read less data or read repeatedly?
For example, my program is reading a newly generated, only 30M file, after a while this file will be merged with other files to 600M large file. So when my program reads this big file, doesn't it duplicate the data?

clean.retain_commits was 1

That means each time a new version of file generated, the old one would be deleted, for "COW" table, there is very high possibility you would encouter file missing exception because files are being deleted for every new commits. Can you just keep the clean.retain_commits as default to give the streaming reader some buffer time to read the new files.

By the way,how to configue the clean.async.enabled

Should be true if you do not want redundant legacy files on the filesystem.

Then why are there always small files in the partition a few days ago that are constantly rebuilt and deleted? There is no more data written to these partitions.
I think increasing the parameters of retention cleanup will probably generate more files

Are you enabling the clustering then? The clustering would rewrite all the partitions.

I think increasing the parameters of retention cleanup will probably generate more files

The small files are not affected by the cleaning strategy.

We have increase the parameter,and the downstream flink program does not encounter error.
But I found the file<PHONE_NUMBER>3048129.replacecommit http://<IP_ADDRESS>:13000/hue/filebrowser/view=/hudi/ods_vgc/ods_vgc_itp_tss_rli/.hoodie/20240509163048129.replacecommit in .hoodie directory, it’s intent is below.
{
"partitionToWriteStats" : {
"20240207/clamp" : [ {
"fileId" : "6849d48e-8141-4774-bc16-4020b039cc3d-0",
"path" : "20240207/clamp/6849d48e-8141-4774-bc16-4020b039cc3d-0_0-1-0_20240509163048129.parquet",
"cdcStats" : null,
"prevCommit" : "null",
"numWrites" : 97,
"numDeletes" : 0,
"numUpdateWrites" : 0,
"numInserts" : 97,
"totalWriteBytes" : 452622,
"totalWriteErrors" : 0,
"tempPath" : null,
"partitionPath" : "20240207/clamp",
"totalLogRecords" : 0,
"totalLogFilesCompacted" : 0,
"totalLogSizeCompacted" : 0,
"totalUpdatedRecordsCompacted" : 0,
"totalLogBlocks" : 0,
"totalCorruptLogBlock" : 0,
"totalRollbackBlocks" : 0,
"fileSizeInBytes" : 452622,
"minEventTime" : null,
"maxEventTime" : null,
"runtimeStats" : {
"totalScanTime" : 0,
"totalUpsertTime" : 0,
"totalCreateTime" : 61
}
} ], <>
Will my downstream application consume data repeatedly？
I am afraid my application would  consume data repeatedly.

2024年5月7日 12:35，Danny Chan @.***> 写道：
Are you enabling the clustering then? The clustering would rewrite all the partitions.
I think increasing the parameters of retention cleanup will probably generate more files
The small files are not affected by the cleaning strategy.
—
Reply to this email directly, view it on GitHub https://github.com/apache/hudi/issues/11090#issuecomment-2097428203, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHH2Q2SLW3RF6LSJBEZES73ZBBKYXAVCNFSM6AAAAABGYIXP6OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJXGQZDQMRQGM.
You are receiving this because you are subscribed to this thread.

my downstream flink did not encounter file not exception while the upstream increase the clean.commits parameter.

I checked if my downstream program was re-reading old partition data yesterday and I found no rereading, at this time I was not configured to skip the cluster file.
---Original---
From: "Danny @.>
Date: Fri, May 10, 2024 08:29 AM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [apache/hudi] [SUPPORT]Flink Streaming Read hudi table which isin clustering,encounterd file not exists. (Issue #11090)
This is a replace commit, you can choose to skip it with option read.skip_clustering or read.skip_insertoverride enabled.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

thank you
非常感谢你，陈兄。应该解决问题了
---Original---
From: "Danny @.>
Date: Fri, May 10, 2024 08:29 AM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [apache/hudi] [SUPPORT]Flink Streaming Read hudi table which isin clustering,encounterd file not exists. (Issue #11090)
This is a replace commit, you can choose to skip it with option read.skip_clustering or read.skip_insertoverride enabled.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

Thanks for the feedback, feel free to reopen it if you still think it is a problem.

thanks dude,so.nice you are.
---Original---
From: "Danny @.>
Date: Fri, May 10, 2024 17:03 PM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [apache/hudi] [SUPPORT]Flink Streaming Read hudi table which isin clustering,encounterd file not exists. (Issue #11090)
Thanks for the feedback, feel free to reopen it if you still think it is a problem.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

是否必须加合格参数呢？我在下游读的时候
read.skip_clustering

2024年5月10日 17:03，Danny Chan @.***> 写道：
Thanks for the feedback, feel free to reopen it if you still think it is a problem.
—
Reply to this email directly, view it on GitHub https://github.com/apache/hudi/issues/11090#issuecomment-2104233217, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHH2Q2WSFT3DGF2DSL7SW6DZBSENDAVCNFSM6AAAAABGYIXP6OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBUGIZTGMRRG4.
You are receiving this because you are subscribed to this thread.

是否必须加read.streaming.skip_clustering = true,当我读 上游开启了异步cluster的数据？
就是我前几天遇到的问题。我发现没有开启，貌似数据没有重复读。

2024年5月10日 17:03，Danny Chan @.***> 写道：
Closed #11090 https://github.com/apache/hudi/issues/11090 as completed.
—
Reply to this email directly, view it on GitHub https://github.com/apache/hudi/issues/11090#event-12767246972, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHH2Q2UM4EJQY6B52UZC4QLZBSENDAVCNFSM6AAAAABGYIXP6OVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJSG43DOMRUGY4TOMQ.
You are receiving this because you are subscribed to this thread.

是否必须加read.streaming.skip_clustering = true,当我读 上游开启了异步cluster的数据？ 就是我前几天遇到的问题。我发现没有开启，貌似数据没有重复读。


Weird issue

https://github.com/Direwolf20-MC/JustDireThings/assets/76228548/7a7a2c0e-3838-454f-8dcc-b441392e6c1d
the tiled dirt brakes the crops and the items disapear

Working as intended - the items disappear after 2 seconds. Use the item collector to get them :)


Release v0.1.0

Codecov Report

Merging #2 (8447ccf) into main (9f11389) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##              main        #2   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            5         5
  Lines           54        54
=========================================
  Hits            54        54

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9f11389...8447ccf. Read the comment docs.


Improve UmpleOnline editing of classes and state machines

In UmpleOnline's G mode (graphviz class diagram) one can right-click on a class name, bringing up a menu that says 'add attribute', rename class, etc.
Suggested improvements

It would be good if double-clicking would have the same effect, as right-clicking might not be intuitive.
Enable clicking on an attribute, with it bringing up a menu to delete the attribute, change its type and rename it
If I right-click on a transition, it would be good if it would enable me to edit it.
It would be good if users somehow would know that they can double-click or right click! ... e.g. if the hover message would say 'right click to edit' ... note that we shold also ensure that PR #1908 for issue #1867 is either redone or finished in conjunction with this

I am not sure why I didn't list associations as well as transitions. But yes the idea is that if the user clicks on one it would seem that one should be able to. delete it, alter the event name and the destination state. For an association one should be able to alter the multiplicity at either end and the role name at either end, and delete it (but maybe not change the classes ... for that I think deleting and adding new would work better perhaps


Unable to run on Manjaro

Hello, I followed the steps in README.md but it can't work. I tried reinstalling it (including rninstalling torch) multiple times. But if I run the lua file, it kept reporting this error:

THCudaCheck FAIL file=/home/dazian/wf2x/torch/extra/cutorch/lib/THC/generic/THCTensorMath.cu line=15 error=8 : invalid device function
/home/dazian/wf2x/torch/install/bin/luajit: ...dazian/wf2x/torch/install/share/lua/5.1/nn/Container.lua:67:
In 1 module of nn.Sequential:
In 1 module of nn.Sequential:
In 1 module of nn.Sequential:
/home/dazian/wf2x/torch/install/share/lua/5.1/nn/THNN.lua:110: cuda runtime error (8) : invalid device function at /home/dazian/wf2x/torch/extra/cutorch/lib/THC/generic/THCTensorMath.cu:15
stack traceback:
[C]: in function 'v'
/home/dazian/wf2x/torch/install/share/lua/5.1/nn/THNN.lua:110: in function 'SpatialConvolutionMM_updateOutput'
.../torch/install/share/lua/5.1/nn/SpatialConvolutionMM.lua:63: in function <.../torch/install/share/lua/5.1/nn/SpatialConvolutionMM.lua:53>
[C]: in function 'xpcall'
...dazian/wf2x/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
...azian/wf2x/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function <...azian/wf2x/torch/install/share/lua/5.1/nn/Sequential.lua:41>
[C]: in function 'xpcall'
...dazian/wf2x/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
...azian/wf2x/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function <...azian/wf2x/torch/install/share/lua/5.1/nn/Sequential.lua:41>
[C]: in function 'xpcall'
...dazian/wf2x/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
...azian/wf2x/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function 'forward'
lib/reconstruct.lua:52: in function 'reconstruct_nn'
lib/reconstruct.lua:200: in function 'scale_rgb'
lib/reconstruct.lua:240: in function 'scale_f'
waifu2x.lua:99: in function 'convert_image'
waifu2x.lua:294: in function 'waifu2x'
waifu2x.lua:299: in main chunk
[C]: in function 'dofile'
...wf2x/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
[C]: at 0x004060c0

I tried force_cudnn argument, it doesn't work, and kept reporting errors above.
nvidia_smi report:

| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|   0  GeForce GTX 1660    Off  | 00000000:01:00.0  On |                  N/A |
| 25%   34C    P8     6W / 120W |    451MiB /  5941MiB |      4%      Default |

Is that Torch7 my distro repository( https://github.com/nagadomi/distro ) built with CUDA10?
NVIDIA Turing is a new architecture and is not supported by the official Torch7 and older CUDA versions.

OK, I solved it and it seems to be working just fine. Thank you for your help.


Fixes cache entry deletion directly after creation

See
https://github.com/zendframework/zend-cache/issues/183
Only set TTL if there is a value which is not null!

@weierophinney I've added tests to cover changes and prove the issue. Instead of mocking storage and options, I've implemented storage and logged TTL when setting the item in cache. Then in assertion I am checking what value of TTL was set for the item.

Actually using mocking it will be also quite simply:
    public function testUseTtlFromOptionsOnSetMocking()
    {
        $this->options->getTtl()->willReturn(40);
        $this->options->setTtl(40)->will([$this->options, 'reveal']);

        $this->options->setTtl(null)->shouldNotBeCalled();

        $this->storage->getOptions()->will([$this->options, 'reveal']);
        $this->storage->setItem('foo', 'bar')->willReturn(true);

        self::assertTrue($this->cache->set('foo', 'bar'));
    }

    public function testUseTtlFromOptionsOnSetMultipleMocking()
    {
        $this->options->getTtl()->willReturn(40);
        $this->options->setTtl(40)->will([$this->options, 'reveal']);

        $this->options->setTtl(null)->shouldNotBeCalled();

        $this->storage->getOptions()->will([$this->options, 'reveal']);
        $this->storage->setItems(['foo' => 'bar', 'boo' => 'baz'])->willReturn([]);

        self::assertTrue($this->cache->setMultiple(['foo' => 'bar', 'boo' => 'baz']));
    }

But not sure if it is clear enough?
Line
$this->options->setTtl(null)->shouldNotBeCalled();

in both tests is not really needed. It says explicitly that we do not allow that cal, but as we are mocking options anyway, we are saying what calls are allowed (and all others are not).

Thanks, @alexz707!


[resotocore][feat] List cli commands via API

Description
Provide information about available CLI commands via the API.
To-Dos

[x] Add test coverage for new or updated functionality
[x] Lint and test with tox

Codecov Report

Merging #592 (bef3d63) into main (5993df6) will increase coverage by 0.07%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #592      +/-   ##
==========================================
+ Coverage   88.50%   88.58%   +0.07%
==========================================
  Files          64       64
  Lines        8377     8381       +4
==========================================
+ Hits         7414     7424      +10
+ Misses        963      957       -6

Flag
Coverage Δ

resotocore
88.58% <100.00%> (+0.07%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

resotocore/core/web/api.py
63.24% <100.00%> (+0.25%)
:arrow_up:

resotocore/core/web/content_renderer.py
93.75% <0.00%> (+4.16%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5993df6...bef3d63. Read the comment docs.


[THORN-2116] Adding the info about the project stages

Hi Sheldon, what I'm not sure is how to escape "---" sequences within the YAML file, please see the attached image to THORN-2116.

I will wait with my review for when the technical questions are answered.

Ken, re https://docs.thorntail.io/2.3.0.Final-SNAPSHOT/#default-thorntail-yaml-files_thorntail, to me it looks like the new content is different, as it shows how the project-default.xml can have overlaying configuration parts with only one of them activated, 'default', if no -Dswarm.project.stage is provided, or the chosen stage.
I'm less certain about https://docs.thorntail.io/2.3.0.Final-SNAPSHOT/#non-default-thorntail-yaml-configuration-files_thorntail though. It looks like it implies that multiple configuration files can be used at the same time, with this line "The first file containing a given configuration item takes precedence over others" - to me it reads that all the files are consumed but the ordering is applied ?
The new content implies that if -Dswarm.project.stage.file is provided then only a single file is loaded...

Just looked at the links Ken mentioned -- yea, that's my concern as well. The text added in this PR describes an old style of using project stages, while https://docs.thorntail.io/2.2.0.Final/#configuring-a-thorntail-application-using-yaml-files_thorntail describes a new style that should be preferred. I'm not sure how much the old style still works -- some of it certainly does (the swarm.project.stage and swarm.project.stage.file system properties), but e.g. the text about multiple stages in a single YAML file, that should certainly be considered deprecated.

Ladislav, Ken, I will just close this PR for now, OK ?

Makes sense to me.

Sure, closing for now, will re-open if needed


Ipopt 3.12.9  for  Win64

Hello,
I don't know how conda works, I only know how to use conda from my Jypiter notebooks!
Sorry for my naive question, but maybe this is here the place to ask.
I have been using Pyomo/Ipopt 3.11  on Win64  for a year now.
I recently tumbled on a bug that seems to be related to Ipopt 3.11 (memory leak), and I was advised to switch  to Ipopt 3.12  (https://github.com/Pyomo/pyomo/issues/399) .
Unfortunately, I could not find the 3.12  version on anaconda.org/conda-forge/ipopt, where I had found  version 3.11 earlier.
After investigation, I had the impression that I would not be able to compile it by myself.
In case I would give it a try anyway to build a win64 version, could you give me a few directions, some (easy) reading?
In case that would be too time consuming for beginners, what would be the chances to get a Win64 version sometimes?
Thanks!
Michel

So the previous windows version just wrapped the binary download options from the main ipopt website (see #11). But for various reasons I think we stopped using that option. You might be better off just looking around to see if there's a win64 binary for ipopt in the version you want?

A few months ago I built win64 packages for ipopt 3.12 and its dependencies: https://anaconda.org/pycalphad
At the time I had to use a custom channel because I built using msys2, but now that it's been added to defaults it's probably possible to port the recipes to conda-forge. I started some of that work in https://github.com/conda-forge/mumps-feedstock/pull/25 but I haven't had time to run all the issues to ground yet.

I had a look at pycalphad.
Unfortunately, Pyomo needs an .exe file for Ipopt.
It seems  you are using a .dll file for pycalphad.
Could the dll be used somehow as an .exe too ?
In also found a Win64 Ipopt 3.12 on the AMPL site.
I also get exceptions with this version, but in other situations (that worked nicely with 3.11).
Can't figure out if the bug could be in Ipopt or Pyomo.
I would need to look at the right place in Pyomo to be sure.
Finally, I tested three version: 3.10, 3.11, 3.12, and had problem with all of them.
But all in all  3.11 seem now the easiest to work with.
Anyway, I am very happy with Ipopt, even  if some models trigger exceptions.

Cleaned up what I had and submitted #18 - you're right that it isn't building ipopt.exe at the moment, that should probably be addressed.


[feat] Support *:<partition name> pattern as a list of valid systems

Fixes #1126.

Hello @mboisson, Thank you for submitting the Pull Request!

In the file reframe/core/pipeline.py:

Line 967:9: E303 too many blank lines (2)

Do see the ReFrame Coding Style Guide

Can I test this patch?

Codecov Report

Merging #1253 into master will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master    #1253   +/-   ##
=======================================
  Coverage   91.42%   91.42%
=======================================
  Files          84       84
  Lines       12401    12412   +11
=======================================
+ Hits        11337    11348   +11
  Misses       1064     1064

Impacted Files
Coverage Δ

reframe/core/pipeline.py
92.43% <100.00%> (+0.08%)
:arrow_up:

unittests/test_pipeline.py
95.34% <100.00%> (+0.03%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ebf0141...6444559. Read the comment docs.

test this please

Looks like I need to think about this a bit more... 🤔

Actually you can try to run the unit tests yourself by running ./test_reframe.py. It accepts all the pytest options.

Ok, should be good now.

@mboisson my plan is to merge this today, so I will go on with the solution of changing the type of the valid_systems field.

@teojgo Can you approve this one?


Error: Invalid URL given!

Hello,
First, this extension is truly an awesome idea!
I have a backend running locally, so on http:// only, and when I run a request, I get Error: Invalid URL given! error and nothing more.
Here is the code:
POST http://localhost:3000/myendpoint
Content-Type: application/json

{
    "value": 1
}

The backend works fine, since calling it with wget, curl and VS Code RESTClient extension all work fine. Is it because http:// is not supported ?
I run REST Book version 2.1.0 on VS Code 1.57.1 (below are VS Code details)
Version: 1.57.1 (user setup)
Commit: 507ce72a4466fbb27b715c3722558bb15afa9f48
Date: 2021-06-17T13:28:07.755Z (4 days ago)
Electron: 12.0.7
Chrome: 89.0.4389.128
Node.js: 14.16.0
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.19042

Thanks.

Hey! hmm I can't seem to repro your issue. When I'm running a simple express server I see this:

Is there anything else I'm missing? Would I be able to test against your backend?

I think the reason is because I'm not running an insider build.
Here https://github.com/tanhakabir/rest-book/blob/main/src/common/request.ts#L186 the tokens contains the whole code split on spaces, including line feeds, so it looks like this:
[
    'POST',
    'http://localhost:3000/myendpoint',
    '',
    'Content-Type:',
    'application/json',
    etc...
]

I'll just wait for next VS Code release and retry.

Hmm on that line when you log the tokens you see [ 'Content-Type:', 'application/json' ] in there? That's unexpected because that function is only splitting the first line of the request sho it should be just: [ 'POST', 'http://localhost:3000/myendpoint' ]

I opened file <home>\.vscode\extensions\tanhakabir.rest-book-2.2.0\dist\extension-node.js file and added a few logs.
https://github.com/tanhakabir/rest-book/blob/main/out/common/request.js#L12
query prints this:

https://github.com/tanhakabir/rest-book/blob/main/out/common/request.js#L112
this.originalRequest prints this (twice):

https://github.com/tanhakabir/rest-book/blob/main/out/common/request.js#L120
tokens prints this:

I'm running on Windows 10.
I hope this helps.

Thanks this is helpful! I'll take a look later today

I just ran into this, in my case it seems to be an issue between Windows line ends (\r\n) and unix line ends \n. In my case VSCode is set to use unix line ends, on a Windows system. If I modify the json to have \r\n in place of the unix line ends in the json strings it works as expected. But the rest book editor is writing \n into the json strings.


[#2411] Add Apache Ranger Docker CI image and integration test

What changes were proposed in this pull request?
This future includes：

A Gravitino Ranger CI Docker image
Add Ranger integration test

Why are the changes needed?
Created an Apache Ranger Docker image myself, because Apache Ranger's official Docker image has 5 child docker images, It's very complex.
Fix: #2411
Does this PR introduce any user-facing change?
N/A
How was this patch tested?

Created datastrato/gravitino-ci-ranger:0.1.1 Docker image and pushed hub.docker.com successed.
CI Passed

Could you add a document for this this pr in the docker-image-details.md?

Could you add a document for this this pr in the docker-image-details.md?

I already added document Gravitino CI Apache Ranger image in it.

Have you released a Docker image by using this pr?

Have you released a Docker image using this pr?

Yes, I success create Ranger Docker image use this PR, https://hub.docker.com/r/datastrato/gravitino-ci-ranger/tags

@qqqttt123 Please help me review this PR, Thanks.


callonce is running multiple time in scenario outline | expected to run only once and provide same results always

IMPORTANT: If you have a general question please use Stack Overflow instead where Karate has a dedicated "tag": https://stackoverflow.com/questions/tagged/karate
If you are sure you have found a bug, please make sure you follow the instructions here: https://github.com/intuit/karate/wiki/How-to-Submit-an-Issue

see second link above


Connection to an external Spark cluster

When running OpenRefine with the Spark runner, we always spin a local Spark instance for it. We should instead make it possible to configure OpenRefine to connect to an existing Spark cluster for this.
Proposed solution
Introduce the relevant configuration variables for the Spark runner to make this possible.

One other approach which looks also promising to me is to make it possible to have the workspace itself accessed via HDFS.
Having the possibility of executing a workflow directly from a file is appealing on paper, but it is likely to be quite slow as soon as the original file is not splittable. Most import formats that OpenRefine supports are not splittable (even CSV with the default settings) so you'd be limited to running the workflow on a single node, which defeats the purpose of Spark.


Adding symbols, JSON->JAVA?

When I am trying to convert json scheme to java object and I have an enum which are symbols like ":", "<", etc. The problem there is that when these enums are converted to java, they are done as : "EMPTY(":", "\u2265", "<");" and this token EMPTY is generating an error which is correct since the names to these symbols cant be found. Any solutions for this problem? Thanks in advance.

PS. I am using Maven plugin to do that.

Could you give me an example?

I have something like this in my json scheme:
"operation": {
"type": "string",
"enum": [ ":", "≥", "<" ]
when this is converting to java object i get something like this:
**public enum Operation {
EMPTY(":", "\u2265", "<");
private final String value;
......**

Ah, I see. There are no characters in your enum that are valid in a Java identifier.
If you can change the schema, you can add some meaningful names to your enum values using javaEnumNames like this:
https://github.com/joelittlejohn/jsonschema2pojo/blob/f23641fb5a492d86f2e8de001299f21353601df8/jsonschema2pojo-integration-tests/src/test/resources/schema/enum/enumWithCustomJavaNames.json
In this case we don't really have anything useful in the schema to use as a Java identifier. There's still a bug though, you should probably have got:
EMPTY(":"),
EMPTY_("\u2265"),
EMPTY__("<")


Automated cherry pick of #1745: fix deploy network with routes

Cherry pick of #1745 on release/2.11.0.
#1745: fix deploy network with routes

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.11.0@eb0b78b). Click here to learn what that means.
The diff coverage is 0%.

@@               Coverage Diff                @@
##             release/2.11.0   #1746   +/-   ##
================================================
  Coverage                  ?   7.65%
================================================
  Files                     ?     412
  Lines                     ?   63158
  Branches                  ?       0
================================================
  Hits                      ?    4834
  Misses                    ?   57916
  Partials                  ?     408

Flag
Coverage Δ

#aFlag
7.65% <0%> (?)

Impacted Files
Coverage Δ

pkg/hostman/guestfs/fsdriver/nicteaming.go
0% <0%> (ø)

pkg/hostman/guestfs/fsdriver/base.go
13.72% <0%> (ø)

pkg/hostman/guestfs/fsdriver/esxi.go
0% <0%> (ø)

pkg/util/netutils2/netutils.go
27.82% <0%> (ø)

pkg/hostman/guestfs/fsdriver/android.go
0% <0%> (ø)

pkg/hostman/guestfs/fsdriver/windows.go
0% <0%> (ø)

pkg/hostman/guestfs/fsdriver/macos.go
0% <0%> (ø)

pkg/hostman/guestfs/fsdriver/linux.go
0% <0%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eb0b78b...5b8b36d. Read the comment docs.

/lgtm
/approve