[FLINK-31293][runtime] LocalBufferPool request overdraft buffer only when no available buffer and pool size is reached

What is the purpose of the change
In our current implementation, once there is no available buffer, overdraft buffers can. be requested, which does not meet our requirements for the name the overdraft. In fact, we expect only request additional buffers when the pool size is reached.
Another key point is the definition of LocalBufferPool's available status. Actually, before overdraft buffer was introduced, its definition was very clear:
There is at least one availableMemorySegment and no subpartitions has reached maxBuffersPerChannel.
IMO, Introducing the overdraft mechanism should not break this protocol. Otherwise, it may cause some very hidden bugs.
It should be noted that even if we only allow request overdraft buffers after reaches the poolSize, there may still be a situation where both availableMemorySegment and overdraft buffer are all not zero, and this state should obviously be defined as available.
Brief change log

Add missing @GuardedBy annotation for LocalBufferPool.
LocalBufferPool request overdraft buffer only when no available buffer and pool size is reached.

Verifying this change
Manually test this change by running TPC-DS and added unit tests.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): yes
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no

@1996fanrui and @wsry, would you mind taking a look at this? This pr currently can be reviewed, but not the final status. Because there may be some tests to be added and migrated to junit5.

Thanks @1996fanrui for the review, I have updated this as your comment, PTAL.

Thanks @1996fanrui for the review and catch the bug, I have updated this according to your comments, please take a look again.

Thanks @akalash and @1996fanrui for the review.

Is there an easy way to check that we allocate an overdraft buffer only when isRequestedSizeReached? I mean we can create test version of networkBufferPool to check this

The main reasons why I don't think there's an easy way are:

NetworkBufferPool does not distinguish between overdraft and non-overdraft buffers request.
NetworkBufferPool itself is not an interface, it is not easy to make a very beautiful mock for it (i.e. TestingNetworkBufferPool), of course it can also be done through inheritance, but this will make our test still partly dependent on its implementation.

One solution I can think of is: we keep requesting and returning buffers until there are currentPoolSize buffers in availableMemorySegment. Next, we intercept the requestPooledMemorySegment method of the test version
of NetworkBufferPool and keep requesting buffers. Then we check that this method will be called only isRequestedSizeReached() is satisfied. Is this really necessary compared to the complexity? The tests introduced in this PR already cover this part, at least to some extent.
Perhaps it is enough if we can adding more checks for tests like testDecreasePoolSize to ensure that the condition must be met before requesting the overdraft buffer. WDYT?

FYI：If there are no other concerns, I will merge this PR tomorrow.

FYI：If there are no other concerns, I will merge this PR tomorrow.

Thanks for your work, it's ok from my side.

it is ok from me as well but doesn't forget to squash the two last commits

Squash the two last commits. Merged % CI green.


Expose sliding window attn to TE-JAX API

Description
Recent models employ sliding window attention (SWA). Some frameworks use cuDNN fused attention through the TE-JAX Flash Attention API. The SWA support has not been exposed to this API yet. However, on the backend TE does have support for the SWA. This PR expose the SWA support to the Flash Attention API.
Type of change

[ ] Documentation change (change only to the documentation, either a fix or a new content)
[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Infra/Build change
[ ] Code refractor

Changes
Please list the changes introduced in this PR:
Expose sliding window attention to the TE-JAX API
Checklist:

[x] I have read and followed the contributing guidelines
[x] The functionality is complete
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

Could you port the SWA to flax and praxis modules as well?

Hi, MaxText is using the DotProductAttention API from transformer_engine/jax/flax/transformer.py. It'd be super useful to expose the SWA to this

Hi @kocchop I am working on it, should be able to commit new changes next week

PR #1212 affects this PR. Maybe we should wait for this PR.

@zlsh80826, could you help review this PR as well? Thanky you.

@zlsh80826, could you help review this PR as well? Thanky you.

Sure, I will review it by this week.

/te-ci jax

/te-ci jax

/te-ci jax


fix: disable updating zone_id for host, storage, wire

这个 PR 实现什么功能/修复什么问题:
修正：不允许修改host ,storage, wire的zone_id

是否需要 backport 到之前的 release 分支:

release/3.2

/cc @zexi
/area region

Codecov Report

Merging #6772 into master will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #6772   +/-   ##
=======================================
  Coverage    7.13%    7.13%
=======================================
  Files         650      650
  Lines      109894   109894
=======================================
+ Hits         7843     7845    +2
+ Misses     101445   101444    -1
+ Partials      606      605    -1

Flag
Coverage Δ

#aFlag
7.13% <ø> (+<0.01%)
:arrow_up:

Impacted Files
Coverage Δ

pkg/compute/models/hosts.go
0.30% <ø> (ø)

pkg/compute/models/storages.go
0.91% <ø> (ø)

pkg/compute/models/wires.go
1.41% <ø> (ø)

pkg/cloudcommon/validators/validators_cert.go
39.77% <0.00%> (ø)

pkg/appsrv/response.go
69.11% <0.00%> (+2.94%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5d17bf6...1e4aced. Read the comment docs.


Machine setupSignals does not scale

I just finished running some pprof analysis on our code and with the latest SDK that now has machine.setupSignals I saw that the select statement eats up the majority of the total cpu time. Especially when the number of vms increases.
I've included a screen shot of the firecracker portion of our cpu pprof

At peak we were running 55 vms on the same host and it was causing 1000% cpu usage for our program managing the vms via the SDK. If I set the m.Cfg.ForwardSignals slice to an empty slice performance increased dramatically, same number of vms but only 22% cpu usage for our program.
I did verify we were not leaking goroutines and that the setupSignals goroutine was being exited when the vm died.

Thank you for the profiling! We should have that somewhere in my pipeline.
The intention of the change (#166) is disabling signal handling in the SDK. So setting the slice empty would be the way to go.
However, I do want to make our default option performant. Can we give up the signal handling in the SDK? Signals are shared by a process. It doesn't fit nicely in the SDK.
Cc: @michaeldwan

According to @nmeyerhans, the original intention of the signal handling is having some sane default to avoid orphaning firecracker processes. So we should not remove the signal handling unless we have better alternatives.

@cpheps I've been trying to reproduce the issue. While I could get a similar pprof graph, ForwardSignals didn't affect the overall performance much.
The test code is currently in my fork: https://github.com/kzys/firecracker-go-sdk/commit/58ec39377b0c44378478df3d8c4148dbdcd502a7
On my z1d.metal EC2 instance, both TestRunMultipleVMWithSignalForwarding and TestRunMultipleVMWithoutSignalForwarding resulted similar results, in terms of perf numbers.
% uptime
 23:55:38 up 22 days,  5:27,  1 user,  load average: 0.00, 0.07, 5.71
% sudo perf stat -a -- sudo DISABLE_ROOT_TESTS= /usr/local/go/bin/go test -run=TestRunMultipleVMWithSignalForwarding
PASS
ok      github.com/firecracker-microvm/firecracker-go-sdk       30.092s

 Performance counter stats for 'system wide':

    1502907.983804      cpu-clock (msec)          #   47.997 CPUs utilized
           155,507      context-switches          #    0.103 K/sec
             5,645      cpu-migrations            #    0.004 K/sec
           506,009      page-faults               #    0.337 K/sec
    69,748,593,803      cycles                    #    0.046 GHz
    31,811,500,826      instructions              #    0.46  insn per cycle
     6,631,695,688      branches                  #    4.413 M/sec
       154,848,478      branch-misses             #    2.33% of all branches

      31.312733676 seconds time elapsed

% sudo perf stat -a -- sudo DISABLE_ROOT_TESTS= /usr/local/go/bin/go test -run=TestRunMultipleVMWithoutSignalForwarding
PASS
ok      github.com/firecracker-microvm/firecracker-go-sdk       30.084s

 Performance counter stats for 'system wide':

    1488668.960217      cpu-clock (msec)          #   47.995 CPUs utilized
           152,219      context-switches          #    0.102 K/sec
             5,735      cpu-migrations            #    0.004 K/sec
           482,550      page-faults               #    0.324 K/sec
    63,349,661,892      cycles                    #    0.043 GHz
    27,676,147,166      instructions              #    0.44  insn per cycle
     5,806,599,701      branches                  #    3.901 M/sec
       137,671,057      branch-misses             #    2.37% of all branches

      31.017347468 seconds time elapsed

%

@kzys Took a look at your test and look like what I would expect. I did see one difference in that we set ForwardSignals = []os.Signal{} before we call NewMachine. Looking at the code this should be no difference. Do that though did improve performance for us and removed that issue.

Yeah. Setting that before calling NewMachine seems no-op because of https://github.com/firecracker-microvm/firecracker-go-sdk/blob/f8acfc43bfbe27b5c80264662f992573fdc0a20b/machine.go#L348.
How did you measure the performance? CPU Utilization is something misleading. Did it actually increase the performance which is measured by wall-clock time?

Right so my measurement was just watching top for our process. When the go routines in setupSignals were not created the cpu measurement in top went from 1000% to ~20%

@kzys Did a quick read through I might know why you're not seeing improvements in your test. The Config is not a pointer that is passed to NewMachine
https://github.com/firecracker-microvm/firecracker-go-sdk/blob/f8acfc43bfbe27b5c80264662f992573fdc0a20b/machine.go#L303
So when it's set to the OS signals and set on the machine it's a modified copy of the one you still have a handle on in your tests
https://github.com/firecracker-microvm/firecracker-go-sdk/blob/f8acfc43bfbe27b5c80264662f992573fdc0a20b/machine.go#L348-L358
In your tests when you set machine.Cfg.ForwardSignals = nil you're only changing your local copy not the one the machine is using.

@cpheps Thanks.  Let me check that again tomorrow.

@cpheps I can reproduce the issue and see the difference in wall-clock time. Yes. ForwardSignals does make the host busier.
% sudo perf stat -a -- sudo DISABLE_ROOT_TESTS= ~/src/go1.11.13/bin/go test -run=TestRunMultipleVMWithSignalForwarding
starting 300 VMs
PASS
ok      github.com/firecracker-microvm/firecracker-go-sdk       4.326s

 Performance counter stats for 'system wide':

        532,034.11 msec cpu-clock                 #   95.889 CPUs utilized
           234,664      context-switches          #  441.070 M/sec
            14,358      cpu-migrations            #   26.987 M/sec
         1,079,383      page-faults               # 2028.786 M/sec
 1,155,639,302,716      cycles                    # 2172115.509 GHz
 1,352,360,504,475      instructions              #    1.17  insn per cycle
   317,303,636,622      branches                  # 596397291.568 M/sec
     1,421,472,029      branch-misses             #    0.45% of all branches

       5.548415648 seconds time elapsed

% sudo perf stat -a -- sudo DISABLE_ROOT_TESTS= ~/src/go1.11.13/bin/go test -run=TestRunMultipleVMWithoutSignalForwarding
starting 300 VMs
PASS
ok      github.com/firecracker-microvm/firecracker-go-sdk       0.939s

 Performance counter stats for 'system wide':

        208,201.10 msec cpu-clock                 #   95.664 CPUs utilized
           147,282      context-switches          #  707.403 M/sec
            12,860      cpu-migrations            #   61.767 M/sec
         1,068,457      page-faults               # 5131.853 M/sec
   110,600,490,679      cycles                    # 531219.786 GHz
    53,971,928,336      instructions              #    0.49  insn per cycle
    11,255,269,198      branches                  # 54059630.828 M/sec
       236,858,202      branch-misses             #    2.10% of all branches

       2.176368102 seconds time elapsed

@cpheps The SDK is not removing signal handling channels correctly. That means, we may be leaking goroutines. The fix is #204!

Awesome! Thanks @kzys for chasing down a fix.


chore: Implement defense feedback

What does this PR do?
This PR changes files and variable' names to be more descriptive and improves the styling of the NotFound page
Description of Task to be completed?
NotFound page should be better styled and the variables and files name more descriptive

Coverage remained the same at 84.145% when pulling 1f5e08651011855f9d87f4878c0f39bf84bd5bfb on implement-defence-feedback into be597a2f30a52e0223274d70c61fe2ab5906cd22 on develop.

Coverage remained the same at 84.145% when pulling d8387f21d8d08d87c087a295b62766cc340b6d20 on implement-defence-feedback into be597a2f30a52e0223274d70c61fe2ab5906cd22 on develop.

Coverage increased (+0.2%) to 84.371% when pulling e9bc26913b16cc50be10718ed3f8c4b173fcdb5f on implement-defence-feedback into be597a2f30a52e0223274d70c61fe2ab5906cd22 on develop.

Coverage increased (+0.2%) to 84.371% when pulling e9ac8f52a03215a52a2aaa80f983e03c9e6c037c on implement-defence-feedback into be597a2f30a52e0223274d70c61fe2ab5906cd22 on develop.


IDs shifted in GJGarageLayer

Platform
Windows
SDK commit
No response
Geode Version
v1.3.3
Mods Installed
No response
Expected Behavior
The IDs to be assigned to the right elements.
Actual Behavior
The IDs get shifted by one.

Steps to Reproduce

Be logged out
Change your display name in the garage
Leave and open the garage, you will see that all the element IDs are shifted

Additional Information
No response

fixed with (dd0179c), should be fixed in 1.3.5

uhhh i think it's fixed, might need testing


Update OIDC Documentation to Include S3 and Dynamo

Describe the Issue
We want to remove the s3 and Dynamo deployments from our Terraform automation, so the documentation should be updated accordingly.
Additional Context
Add any other context, attachments or screenshots
Acceptance Criteria

Create a document describing how to use GitHub OIDC with Terraform in the SEA
Include s3 bucket creation and Dynamo table creation in the docs

.
.
.
.
.
.
.
.
.
.
.
Extra Template Info
Definition of Ready
These set of conditions will need to be met in order to bring a ticket into the sprint and start work. Protects the team from unclear requirements.
Issues (Task/Story/Spike) aligned to an EPIC and linked appropriately.
Assigned to the appropriate CPF MEMBER (and is not left blank in ZenHub) at the start of sprint (1st day of the sprint)
Acceptance has been defined for the issue and has been reviewed with CPF team and approved by the necessary approver.
Has been sized and estimated by the delivery team.
Detailed breakdown of the steps required to complete the story in the additional context
Any additional specifications have been documented, reviewed with CPF and approved by the necessary approver.
Acceptance Criteria
A set of pre-defined requirement that need to be met in order to mark the user story as “done”.
It should be testable with no room for interpretation
It should be either “pass” or “fail”
It should be clear enough for business stake holders to understand
As part of the user story, it should be written from the user perspective
A well written acceptance criteria is great for

managing expectations
defining scope
reducing ambiguity
establishing testing criteria for QA
Given (Pre-condition)
When (Action)
Then (Outcome)

Definition of Done
These set of conditions are met for work to be considered as complete on an issue.
All acceptance criteria(s) have been validated.
All the necessary documentation for the issue has been uploaded to Teams.
Functionality has been tested when applicable.
Functionality has been demonstrated to the relevant stakeholders (where applicable).
Story has been scheduled for a Sprint Demo/community update and impacted teams invited to the Demo.
Stories accepted by PO and documented for potential sharing with impacted users.

Documented = Captured in Community Update (CU) deck
Release notes = aspirational goal of providing a bulleted list of features and changes that our users can touch. Was going to store them in our Cloud Pathfinder repo. Can also display to users in the CU

https://bcgov.github.io/cloud-pathfinder/Github_OIDC/


Fix [CameraManager].getCamera()

This PR changes (delete as applicable)

Nothing, it's a bug fix

Describe the changes below:
[CameraManager].getCamera() returns the requested camera

Request on comment

👍


Add support for trades without Flashloans

This upgrade will allow arbitrage trades to be executed without taking a Flashloan.

Released in Bot 3.0


Build Only the Bridge Module

apollo master
Hello, I modified the scripts  in modules/bridge, but it would take a lot of time to rebuild all of them. How can I build only the bridge module?
你好，我修改了modules/bridge里的脚本，但是全部重新build将会花大量时间，我怎么样才能只buildbridge模块呢

apollo master
Hello, I modified the scripts in modules/bridge, but it would take a lot of time to rebuild all of them. How can I build only the bridge module?
你好，我修改了modules/bridge里的脚本，但是全部重新build将会花大量时间，我怎么样才能只buildbridge模块呢

./apollo.sh build bridge

@rubingLi if you only modified some scripts, Bazel will only build that relevant code. It should be quite fast also.

Thank you


How to interpret the two output values of the offgaze_score and eye_orientation?

{{How to interpret the two output values of the offgaze_score and eye_orientation}}
Context
Please provide any relevant information about your setup. This is important in case the issue is not reproducible except for under certain conditions.

Firmware Version:
Operating System: windows
SDK version:  V1.0.0
Toolchain version:

Expected Behavior
Please describe the behavior you are expecting
Current Behavior
What is the current behavior?
Failure Information (for bugs)
Please help provide information about the failure if this is a bug. If it is not a bug, please remove the rest of this template.
Steps to Reproduce
Please provide detailed steps for reproducing the issue.

step 1
step 2
you get it...

Failure Logs
Please include any relevant log snippets or files here.

Closing since it duplicates this issue https://github.com/worldcoin/open-iris/issues/16


ERROR: SQLSTATE[22S03]: <>: 3617 Latitude 122.232690 is out of range in function st_pointfromtext.

[2023-04-26 09:01:41] production.ERROR: SQLSTATE[22S03]: <>: 3617 Latitude 122.232690 is out of range in function st_pointfromtext. It must be within [-90.000000, 90.000000]. (Connection: mysql, SQL: insert into position (point, speed, direction, signal, date_at, date_utc_at, device_id, timezone_id, trip_id, user_id, vehicle_id) values (ST_PointFromText("POINT(122.232690 10.647180)", 4326), 0, 0, 1, 2023-04-26 17:01:38, 2023-04-26 09:01:38, 1, 259, 1, 1, 1)) {"exception":"[object] (Illuminate\Database\QueryException(code: 22S03): SQLSTATE[22S03]: <>: 3617 Latitude 122.232690 is out of range in function st_pointfromtext. It must be within [-90.000000, 90.000000]. (Connection: mysql, SQL: insert into position (point, speed, direction, signal, date_at, date_utc_at, device_id, timezone_id, trip_id, user_id, vehicle_id) values (ST_PointFromText("POINT(122.232690 10.647180)", 4326), 0, 0, 1, 2023-04-26 17:01:38, 2023-04-26 09:01:38, 1, 259, 1, 1, 1)) at /var/www/html/vendor/laravel/framework/src/Illuminate/Database/Connection.php:793)

What GPT tracking device are you using?

I think is related with MySQL version: https://dba.stackexchange.com/a/242004/23729
Anyway I have sent a patch to force always same parameters order: https://dba.stackexchange.com/a/313905/23729

Im using ST-901M Sinotrack GPS Tracker

Ok, update the code and test it again :)

Hi, here's the update. Data are now saving. here's another issue. see the image attached.

coordinates are not working on map.

I think it should be Lat-Long order.

Can you send me the socket log stored in Server > Logs > server / 2023-04-27 / 8091.log
Please, send the trace to lito at eordes.com to avoid expose your device IDs.

I just sent the 8091.log on your email.
Thanks

I have found the error, but to be fixed the trips must be deleted because coordinates range.
You can import the trips again from logs using the command:
php artisan server:log:read --file storage/logs/server/2023-04-XX/8091.log --protocol h02

It's ok?

Hi, here's the update. it's now working.

I think this is now resolved. thanks a lot.

Thank you very much for your collaboration!
Closing :)


Release 3.33.0

:tada: This PR is included in version 3.32.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Adding leonardo for generating colors & new fonts

Adding Leonardo to generate colors by contrast ratio.
Also added new font family from Adobe Fonts

Omg this looks so nice.


Update stable version in repo from 2.0.0 to 2.1.0

Think about update stable version to 2.1.0
Version: stable=2.0.0 (174 days old) => latest=2.1.0 (30 days old)
Installs: stable=3326 (49.82%), latest=248 (3.71%), total=6676
Click to use developer portal
Click to edit
Do not close this issue manually as a new issue will be created if condition for update still exists.
Please drop a comment if any reason exists which blocks updating to version 2.1.0 at this time.
Note: This is an automatically generated message and not personally authored by bluefox!
@mcm1957 for evidence

This issue seems to be outdated.
This issue suggests to update the stable version of this adapter to 2.1.0 but the current stable version is already 2.1.0.
So this issue should be closed.
@mcm1957 for evidence


fix: the log-cache instance number can not be adjusted

Description
This change makes the log-cache instance number adjustable in user's values.yml file.
Motivation and Context
the log-cache instance number can not be adjusted in user's values.yml file, and it's hard to have multiple log-cache instances.
How Has This Been Tested?

tested with values.yml without log-cahce instances defined
tested with values.yml with 3 log-cache instances

Screenshots (if appropriate):
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My code has security implications.
[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.

Note that log-cache was intentionally removed from the doppler instance group so that it can be made a singleton: https://github.com/cloudfoundry-incubator/kubecf/pull/619
There is some theory that log-cache has a memory leak when running with more than one instance due to the way the caches communicate with each other: https://github.com/cloudfoundry/log-cache-release/issues/29
Later experiments seem to indicate that log-cache doesn't have a leak, but uses the total memory size of the node it is running on to determine the cache size, making it look like it has unbounded memory usage: https://github.com/cloudfoundry/gosigar/issues/48
This issue still seems unresolved, so I don't think it is pre-mature to allow the instance count to be increased right now.
Once the memory configuration question has been resolved, we should first decide if log-cache should be returned to the doppler instance group before deciding if log-cache needs to be independently scalable.

@jandubois thank you for your comment, I don't know the history, and your comment helped me a lot.
I think only one log-cache POD is not good for a production environment, and seems like no quick solution for https://github.com/cloudfoundry/gosigar/issues/48 . A workaround for the memory issue could be to set a lower memory percent for log-cache: https://github.com/cloudfoundry/log-cache-release/blob/develop/jobs/log-cache/spec#L35-L37
Another blocking issue for multiple log-cache PODs is https://github.com/cloudfoundry-incubator/kubecf/issues/1307 , the log-cache will not be functional when there are multiple log-cache PODs, because their NODE_INDEX is same (0),  please see: https://github.com/cloudfoundry/log-cache-release/blob/fa637cd7e2899d58930f893e52b9911cb8672755/src/internal/cache/log_cache.go#L181-L221
Adding below statements to log-cache.yml could make each log-cache POD has different NODE_INDEX, but this is only working for non-multi-az,  when multi-az is enabled, the log-cache in different az will have deplicated NODE_INDEX.
- type: replace
  path: /instance_groups/name=log-cache/jobs/name=log-cache/properties/quarks?
  value:
    envs:
    - name: NODE_INDEX
      valueFrom:
        fieldRef:
          fieldPath: metadata.labels['quarks.cloudfoundry.org/pod-ordinal']

@JimmyMa We talked about this PR in our planning meeting today and created #1312 to create a PR to fix the issue upstream.
If we do decide to merge this PR, it should be changed so that even when high_availability is set, the count remains at 1, and the values.yaml entry should have a warning about increasing the instance count.
Here is a workaround we used before to limit the log-cache memory growth:
bosh:
  instance_groups:
  - name: log-cache
    jobs:
    - name: log-cache
      properties:
        memory_limit_percent: 3

This of course requires that all your node have the same total memory size; otherwise you need to use taints and tolerations to limit your log-cache pods to nodes with a uniform size.
I think I would prefer to not make any changes until the upstream issue has been fixed; it all feels like a hack otherwise.
Once upstream can determine the memory available inside the pod, we can set a memory limit, and everything should start working. Is there a reason we shouldn't then move log-cache back into the doppler role (like cf-deployment) instead of having it in its own instance group?

Since I was just looking at a BPM rendering issue, I wanted to leave this here, for whenever we get back to it:
The reason NODE_INDEX is wrong is because it is set in bpm.yml.erb from spec.id: https://github.com/cloudfoundry/log-cache-release/blob/3229f06/jobs/log-cache/templates/bpm.yml.erb#L9-L11
Quarks-operator is rendering bpm.yml.erb just once in the ig job and uses the rendered file to generate the pod spec for the stateful sets. That means spec.address, spec.index, spec.id, etc. in BPM template rendering always contain the value for instance 0.


Dashboard: Silently errors out when opened

SQL Operations Studio Version: 0.30.3
Steps to Reproduce:

Open the databases folder in OE for any server.
Open 2-3 different databases in succession.

Expected - The dashboard for that database opens (perhaps in a new tab)
Actual - SQL Ops errors out silently throwing this error -
C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\zone.js\dist\zone-node.js:2251 ERROR Error: ViewDestroyedError: Attempt to use a destroyed view: detectChanges
    at viewDestroyedError (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:8665:12)
    at Object.debugUpdateDirectives [as updateDirectives] (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:12810:15)
    at checkAndUpdateView (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:12151:14)
    at callWithDebugContext (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:13213:42)
    at Object.debugCheckAndUpdateView [as checkAndUpdateView] (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:12753:12)
    at ViewRef_.detectChanges (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:10225:63)
    at TabComponent.set [as active] (file:///C:/Users/adbist/Desktop/SQL_Tools/sqlopsstudio/out/sql/base/browser/ui/panel/tab.component.js:35:26)
    at file:///C:/Users/adbist/Desktop/SQL_Tools/sqlopsstudio/out/sql/base/browser/ui/panel/panel.component.js:122:49
    at ZoneDelegate.invoke (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\zone.js\dist\zone-node.js:388:26)
    at Object.onInvoke (C:\Users\adbist\Desktop\SQL_Tools\sqlopsstudio\node_modules\@angular\core\bundles\core.umd.js:4156:37)

And the dashboard is empty. Here's a screenshot -

It's possible that it's related to this error which I have a fix for - https://github.com/Microsoft/sqlopsstudio/pull/1519
Could also be related to this - https://github.com/Microsoft/sqlopsstudio/issues/1499

I can't repro this. All I get is the empty dashboard which is covered by #1549

@anthonydresser sounds good.  I close this as "no repro".  I think #1549 has a consistent repro and appears similar to this.

I had a fix checked in for a similar issue. Looks like it fixed this as well.


Could not find 'nx' module in this workspace.

Hey @javierbrea,
thanks for this post https://www.javierbrea.com/blog/pnpm-nx-monorepo-02/. I build a mono-repo based on your guide. I have one app named myapp and two packages named shared-ui and shared-features.
To build myapp I have following nx-configuration:
"targetDependencies": {
    "start": [
      {
        "target": "build",
        "projects": "dependencies"
      }
    ]
  }

I think nowadays, it could be changed to:
  "targetDefaults": {
    "start": {
      "dependsOn": ["^build"]
    }
  }

Doesn't matter! Either way, I get the following error when I try to start myapp and use latest nx. The packages are built properly, but the myapp start fails.
f I call pnpm nx start myapp, I get following error:
dist/select-utils-14284a03.js              2.84 kB │ gzip: 1.06 kB
✓ built in 3.01s

> nx run myapp:start

Could not find 'nx' module in this workspace. Error: Invalid source or target versions. Source: 5.0, Target: 5.1.
Only backwards compatibility between "5.1" and "5.0" is supported.
This error can be caused by<EMAIL_ADDRESS>packages getting out of sync or outdated project graph cache.
Check the versions running "nx report" and/or remove your "nxdeps.json" file (in node_modules/.cache/nx folder).

It seems the reason is, that nx is installed as a dep of the workspace, as you also prefer and therefore nx run myapp:start get called without pnpm prefixed. What do you think. Do you know, how I can fix this?
Thanks and best regards!

Hey @javierbrea,
thanks for the response.
Here's the output of the nx report:
><EMAIL_ADDRESS>nx /home/node/repo
> nx "report"

 >  NX   Report complete - copy this into the issue template

   Node : 18.15.0
   OS   : linux x64
   pnpm : 8.1.0

   nx          : 15.9.2
   @nrwl/cli   : 15.9.2
   @nrwl/tao   : 15.9.2
   typescript  : 5.0.3

I develop in a docker-container` and this is my Dockerfile:
ARG NODE_VERSION
ARG DISTRO_NAME=bullseye

# we will use node:alpine docker image
FROM node:$NODE_VERSION-$DISTRO_NAME-slim

# Create a directory for the app code

USER node
ENV NPM_CONFIG_PREFIX=/home/node/.npm-global
ENV PATH=$PATH:/home/node/.npm-global/bin

RUN npm install -g pnpm
# Create a directory for the repo code
RUN mkdir -p /home/node/repo
RUN chown -R node:node /home/node/repo

WORKDIR /home/node/repo

and the docker-compose.yml file:
version: '2.4'

x-app: &app
  build:
    context: .dockerdev
    dockerfile: Dockerfile
    args:
      NODE_VERSION: '18.15.0'
  environment: &env
    - NODE_ENV=development
    - HISTFILE=/home/node/repo/logs/.bash_history
  image: my-monorepo:latest
  tmpfs:
    - /tmp

services:
  runner:
    <<: *app
    stdin_open: true
    tty: true
    command: /bin/bash
    ports:
      - "3000:3000"
      - "5173:5173"
      - "4211:4211" # nx graph
    volumes:
      - .dockerdev/.bashrc:/root/.bashrc:ro
      - /app/node_modules
      - ./:/home/node/repo

Hi again @wuarmin,
If the error disappeared then I suppose it was related to the nx cache or to an installation problem.
About your Docker configuration, maybe binding your whole local folder to the project folder inside the Docker container could produce some issues, because the dependencies installed in Docker could differ from the dependencies installed locally (in case you install them also in the host, for example). And it may also produce performance issues due to the huge number of files created by the NPM installation. One thing I usually do is creating a volume and assigning it to the node_modules folder in the Docker container, so it is not shared. For example:
volumes:
  node_modules:
services:
  runner:
    volumes:
      - ./:/workspace # This binds the whole workspace
      - node_modules:/workspace/node_modules #This avoids to share the node_modules folder

Anyway, this is not related to the example in this repository, unless a Docker config example is also added (which, in the other hand, may be interesting 😃 ). So, I'll close the issue. Thanks for sharing!

Hi @javierbrea,
thanks for the input! I changed my config to:
ARG NODE_VERSION
ARG DISTRO_NAME=bullseye

FROM node:$NODE_VERSION-$DISTRO_NAME-slim

# Create a user
USER node
ENV NPM_CONFIG_PREFIX=/home/node/.npm-global
ENV PATH=$PATH:/home/node/.npm-global/bin

# Install pnpm globally
RUN npm install -g pnpm

# Create a directory for the repo code
# here I added the mkdir of the node_modules, in order to have the right permissions as a result
RUN mkdir -p /home/node/repo/node_modules
RUN chown -R node:node /home/node/repo

WORKDIR /home/node/repo

version: '2.4'

x-app: &app
  build:
    context: .dockerdev
    dockerfile: Dockerfile
    args:
      NODE_VERSION: '18.15.0'
  environment: &env
    - NODE_ENV=development
    - HISTFILE=/home/node/repo/logs/.bash_history
  image: gru-bears:latest
  tmpfs:
    - /tmp

services:
  runner:
    <<: *app
    stdin_open: true
    tty: true
    command: /bin/bash
    ports:
      - "3000:3000"
      - "5173:5173"
      - "4211:4211" # nx graph
    volumes:
      - .dockerdev/.bashrc:/root/.bashrc:ro
      - node_modules:/home/node/repo/node_modules
      - ./:/home/node/repo

volumes:
  node_modules:

It works great :+1: , but when I run pnpm install I get the following warnings:
 WARN  EXDEV: cross-device link not permitted, link '/home/node/repo/.pnpm-store/v3/files/27/f6ae491d2e5c8ddaa960eb37288a0ffe10fa55714f79de8c17a3ebe6ae087920f35c17eb5621e1239495c8200cd9f1ba53f33075a4892efddf5a3c8e403b92' -><EMAIL_ADDRESS>Falling back to copying packages from store
 WARN  EXDEV: cross-device link not permitted, link '/home/node/repo/.pnpm-store/v3/files/66/3ede53dcf7e0064de8fb8342a8f466cb79d4dd179cd0bf9b439355482cedcb276af12f6891cf2bcf9127470610878471dcef978ce02ee121057595bcb6ef0f' -> '/home/node/repo/node_modules/.pnpm/@testing-library+jest-dom@5.16.5/node_modules/@testing-library/_tmp_340_bc0400c95c8e19c6857511563c60b171/LICENSE'
Falling back to copying packages from store
 WARN  EXDEV: cross-device link not permitted, link '/home/node/repo/.pnpm-store/v3/files/1d/0688424f69c0e7322aeb720e4e28d9af3b5a7a2dc18b8b198156e377a61a6e05bc824528fca0f8e61ac39b137a028029ff82e5229ad400a3cc22e2bdb687ad-exec' -> '/home/node/repo/node_modules/.pnpm/@types+testing-library__jest-dom@5.14.5/node_modules/@types/_tmp_340_0bf67ca19b0685ee23938177a0b3002d/LICENSE'
Falling back to copying packages from store
 WARN  EXDEV: cross-device link not permitted, link '/home/node/repo/.pnpm-store/v3/files/1d/0688424f69c0e7322aeb720e4e28d9af3b5a7a2dc18b8b198156e377a61a6e05bc824528fca0f8e61ac39b137a028029ff82e5229ad400a3cc22e2bdb687ad-exec' -> '/home/node/repo/node_modules/.pnpm/@types+jest@29.5.0/node_modules/@types/_tmp_340_b5bf7fe67c6e97471844d710cbb8f2b7/LICENSE'
Falling back to copying packages from store
Falling back to copying packages from store
 WARN  2 other warnings
Falling back to copying packages from store

Do you know the reason?
Thanks!

Hi again @wuarmin , it's probably binding also the .pnpm-store folder created by pnpm to your host. You could change the Pnpm settings for creating the store in another folder different to the repo one, or you could create another volume to avoid binding it to the host as well.

 I think this is the related issue for the EXDEV: cross-device link not permitted-issue: https://github.com/pnpm/pnpm/issues/5318.

@wuarmin, I think that it's a good solution 👍

Thanks :+1:


Add Resources and Instructions for Modified LAR users

Using the Modified LAR data from the download page requires several steps that are not likely to be familiar to many users of the data. For example:

File spec. Users need to know that with github you download the "raw" file
File spec. To use as column headers in a spreadsheet like Excel, you have to transpose column to header
Importing to a spreadsheet like Excel: Spec file is .csv with , delimiter, and mLAR is .txtwith | delimiter. Describe steps.
Once imported, the user will need a data dictionary understand field values

Some of these can be solved simply, by adding a few instructions and resource links. We might also consider providing some common spreadsheet files for download with headers already setup.

HMDA-Platform Issue

In reference to providing common spreadsheet files for download with headers set up, could we publish headers on the MLAR data?

2018 MLAR header CSV

MLAR instructions doc suggestions:

what is an MLAR (single institution's submission modified for privacy)
which fields are removed from LAR for privacy reasons
which fields are modified (and how) for privacy reasons
which columns have mixed datatypes
which fields can contain NA
which fields can contain exempt
how to load MLAR to Excel and split data using pipe-delimiter

Using Modified LAR Data
Modified LAR is the public-facing set of the Loan Application Register data
containing fields that are altered or removed for privacy reasons.
Please refer to the schemas or Regulation C for further details on
Modified LAR disclosure.
Opening Modified LAR Text Files With Excel
Modified LAR is downloaded as a pipe-delimited .txt file without descriptive
headers. To read this file in Excel, the following steps would need to be
taken.

Open the .txt file download with Excel.
A window will open to select options for Excel to read the file.
Select "Delimited" in the first window. Click next.
Under delimiters, select "Other" and place a pipe ("|") in the "Other"
field. Click Next.
On the last screen select "General" for data type, and select "Finish."
At this point, the data will populate into their own cells.
Download the Modified LAR Headers File, open the file in Excel, and copy the
first row into your modified LAR excel sheet.

At this point, the Modified LAR download would have the appropriate column
headers.
Code Guide
The following code guide provides an overview of the Modified LAR sheet, the
fields included, fields modified, and new fields added.
Fields and Data Types for Modified LAR

Record Identifier - Data Type: Integer

Legal Entity Identifier(LEI) - Data Type: Character Varying

Loan Type - Data Type: Integer

Loan Purpose - Data Type: Integer

Preapproval - Data Type: Integer

Construction Method - Data Type: Integer

Occupancy Type - Data Type: Integer

Loan Amount - Data Type: Integer or Double

Action Taken - Data Type: Integer

State - Data Type: Character Varying

County - Data Type: Character Varying

Census Tract - Data Type: Character Varying

Ethnicity of Applicant or Borrower: 1 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Applicant or Borrower: 2 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Applicant or Borrower: 3 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Applicant or Borrower: 4 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Applicant or Borrower: 5 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Co-Applicant or Co-Borrower: 1 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Co-Applicant or Co-Borrower: 2 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Co-Applicant or Co-Borrower: 3 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Co-Applicant or Co-Borrower: 4 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Co-Applicant or Co-Borrower: 5 - Data Type: Character Varying (Contains integers or blanks)

Ethnicity of Applicant or Borrower Collected on the Basis of Visual Observation or Surname - Data Type:
Integer

Ethnicity of Co-Applicant or Co-Borrower Collected on the Basis of Visual Observation or Surname - Data Type: Integer

Race of Applicant or Borrower: 1 - Data Type: Character Varying (Contains integers or blanks)

Race of Applicant or Borrower: 2 - Data Type: Character Varying (Contains integers or blanks)

Race of Applicant or Borrower: 3 - Data Type: Character Varying (Contains integers or blanks)

Race of Applicant or Borrower: 4 - Data Type: Character Varying (Contains integers or blanks)

Race of Applicant or Borrower: 5 - Data Type: Character Varying (Contains integers or blanks)

Race of Co-Applicant or Co-Borrower: 1 - Data Type: Character Varying (Contains integers or blanks)

Race of Co-Applicant or Co-Borrower: 2 - Data Type: Character Varying (Contains integers or blanks)

Race of Co-Applicant or Co-Borrower: 3 - Data Type: Character Varying (Contains integers or blanks)

Race of Co-Applicant or Co-Borrower: 4 - Data Type: Character Varying (Contains integers or blanks)

Race of Co-Applicant or Co-Borrower: 5 - Data Type: Character Varying (Contains integers or blanks)

Race of Applicant or Borrower Collected on the Basis of Visual Observation or Surname - Data Type: Integer

Race of Co-Applicant or Co-Borrower Collected on the Basis of Visual Observation or Surname - Data Type:
Integer

Sex of Applicant or Borrower - Data Type: Integer

Sex of Co-Applicant or Co-Borrower - Data Type: Integer

Sex of Applicant or Borrower Collected on the Basis of Visual Observation or Surname - Data Type: Integer

Sex of Co-Applicant or Co-Borrower Collected on the Basis of Visual Observation or Surname - Data Type: Integer

Age of Applicant or Borrower - Data Type: Character Varying

Age of Applicant >= 62 - Data Type: Character Varying

Age of Co-Applicant or Co-Borrower - Data Type: Character Varying

Age of Co-Applicant >= 62 - Data Type: Character Varying

Income - Data Type: Character Varying (Contains integers or 'NA')

Type of Purchaser - Data Type: Integer

Rate Spread - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

HOEPA Status - Data Type: Integer

Lien Status - Data Type: Integer

Applicant or Borrower - Name and Version of Credit Scoring Model - Data Type: Integer

Co-Applicant or Co-Borrower - Name and Version of Credit Scoring Model - Data Type: Integer

Reason for Denial: 1 - Data Type: Integer

Reason for Denial: 2 - Data Type: Character Varying (Contains integers or blanks)

Reason for Denial: 3 - Data Type: Character Varying (Contains integers or blanks)

Reason for Denial: 4 - Data Type: Character Varying (Contains integers or blanks)

Total Loan Costs - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Total Points and Fees - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Origination Charges - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Discount Points - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Lender Credits - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Interest Rate - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Prepayment Penalty Term - Data Type: Character Varying (Contains integers, 'NA' or 'Exempt')

Debt-to-Income Ratio - Data Type: Character Varying

Combined Loan-to-Value Ratio - Data Type: Character Varying (Contains doubles, 'NA' or 'Exempt')

Loan Term - Data Type: Character Varying (Contains integers, 'NA' or 'Exempt')

Introductory Rate Period - Data Type: Character Varying (Contains integers, 'NA' or 'Exempt')

Balloon Payment - Data Type: Integer

Interest-Only Payments - Data Type: Integer

Negative Amortization - Data Type: Integer

Other Non-amortizing Features - Data Type: Integer

Property Value - Data Type: Integer

Manufactured Home Secured Property Type - Data Type: Integer

Manufactured Home Land Property Interest - Data Type: Integer

Total Units - Data Type: Character Varying (Contains integers, 'NA' or 'Exempt')

Multifamily Affordable Units - Data Type: Character Varying (Contains integers, 'NA' or 'Exempt')

Submission of Application - Data Type: Integer

Initially Payable to Your Institution - Data Type: Integer

Automated Underwriting System: 1 - Data Type: Integer

Automated Underwriting System: 2 - Data Type: Character Varying (Contains integers, or blanks)

Automated Underwriting System: 3 - Data Type: Character Varying (Contains integers or blanks)

Automated Underwriting System: 4 - Data Type: Character Varying (Contains integers or blanks)

Automated Underwriting System: 5 - Data Type: Character Varying (Contains integers or blanks)

Reverse Mortgage - Data Type: Integer

Open-End Line of Credit - Data Type: Integer

Business or Commercial Purpose - Data Type: Integer

Fields Removed in the Modified LAR Data Release for Privacy

Universal Loan Identifier (ULI) or Non Universal Loan Identifier (NULI)
Application Date
Action Taken Date
Street Address
City
Zip Code
Ethnicity of Applicant or Borrower: Free Form Text Field for Other
Hispanic or Latino
Ethnicity of Co-Applicant or Co-Borrower: Free Form Text Field for Other
Hispanic or Latino
Race of Applicant or Borrower: Free Form Text Field for American Indian
or Alaska Native Enrolled or Principal Tribe
Race of Applicant or Borrower: Free Form Text Field for Other Asian
Race of Applicant or Borrower: Free Form Text Field for Other Pacific
Islander
Race of Co-Applicant or Co-Borrower: Free Form Text Field for American
Indian or Alaska Native Enrolled or Principal Tribe
Race of Co-Applicant or Co-Borrower: Free Form Text Field for Other Asian
Race of Co-Applicant or Co-Borrower: Free Form Text Field for Other
Pacific Islander
Credit Score of Applicant or Borrower.
Credit Score of Co-Applicant or Co-Borrower
Applicant or Borrower, Name and Version of Credit Scoring Model:
Conditional Free Form Text Field for Code 8
Co-Applicant or Co-Borrower, Name and Version of Credit Scoring Model:
Conditional Free Form Text Field for Code 8
Reason for Denial: Conditional Free Form Text Field for Code 9
Mortgage Loan Originator NMLSR Identifier
Automated Underwriting System: Conditional Free Form Text Field for Code 5
Automated Underwriting System Result: 1
Automated Underwriting System Result: 2
Automated Underwriting System Result: 3
Automated Underwriting System Result: 4
Automated Underwriting System Result: 5
Automated Underwriting System Result: Conditional Free Form Text Field for
Code 16

New Fields Added to Modified LAR
Age of Applicant >= 62
Description: Field that indicates whether the applicant or borrower has an
age greater than or equal to 62.

'Yes'if the age of the applicant is >= 62.
'No' if the age is <= 62.
'NA'if Age of Applicant or Borrower is 8888 or 9999

Age of Co-Applicant >= 62
Description: Field that indicates whether the applicant or borrower has an
age greater than or equal to 62.

'Yes'if the age of the applicant is >= 62.
'No' if the age is <= 62.
'NA'if Age of Applicant or Borrower is 8888 or 9999

Age of Co-Applicant >= 62
Fields Modified for Privacy in the Modified LAR Data
Along with omitted fields, the modified LAR data contains the following
alterations to reported values.
Loan Amount
Description: Each loan amount is listed as the midpoint into which the
reported value falls (For example a reported value of $117834 would be
disclosed $115000 as the midpoint between values = $110000 and < $120000).
Applicant/Co-Applicant Age
Description: Each age value is binned to the following categories:

Ages less than 25 - '<25'
Ages between 25 and 34 - '25-34'
Ages between 35 and 44 - '35-44'
Ages between 45 and 54 - '45-54'
Ages between 55 and 64 - '55-64'
Ages between 65 and 74 - '65-74'
Ages greater than 74 - '>74'

Debt-to-Income Ratio
Description: Exact values between 36% and less than 50% are disclosed as-is.
Non-applicable values are disclosed as-is. Exempt values are disclosed as-is.
All other categories are binned to the following:

Values less than 20% - '<20%'
Values between 20% and less than 30% - '20%-<30%'
Values between 30% and less than 36% - '30%-<36%'
Values between 50% and 60% - '50%-60%'
Values greater than 60%. - '>60%'

Property Value
Description: Each property value is listed as the midpoint into which the
reported value falls (For example a reported value of $117834 would be
disclosed as $115000 as the midpoint between values $110000 and $120000.
Total Units
Description: Exact values between 1 and 4 are disclosed. Other values are
binned according to the following:

Values between 5 and 24 - '5-24'
Values between 25 and 49 - '25-49'
Values between 50 and 99 - '50-99'
Values between 100 and 149 - '100-149'
Values over 149 - '>149'

Multifamily Affordable Units
Description: Values that are not NA or Exempt are disclosed as a percentage
calculated as multifamily affordable units reported / total units reported.


added debug info to OperatorDef

this might be useful for net construction debugging.

@caffe2bot retest this please

onnx has a similar field called doc_string. I think debug_info is a more appropriate name, but to align with onnx maybe we should use doc_string?

doc_string is a very confusing name for a stacktrace

fix is here :) https://github.com/caffe2/caffe2/pull/2013


No  Component Code is visible after clicking show Code

Same to Me.
During transition it is visible...

But when the transition finishes it disappears,

I guess it is a CSS error

Found the cause, the propriety visibility: colapse on class .collpase is not working properly on Accordion Component

When I disability it, everything works just fine

Same problem.

Same issue

Same.  And I was able to view per removing visibility: collapse style as well

Any help is really appreciated!

because of this
https://github.com/tailwindlabs/tailwindcss/blob/master/CHANGELOG.md#320---2022-10-19
https://github.com/tailwindlabs/tailwindcss/pull/9181

Same issue

Same issus.
Can you update the library more than one week we can't use your website or your library !!!
Thanks you.

Please fix site. I'm a noobie, and I can't learning anything from code I can't see.

Oh, I was just going to open an Issue!
Thank you for reporting @kartikpavan !

yeah same here @renatodex

Same here, can't copy sample code as it disappears

Temporary solution while this library is updated : revert to an earlier version of tailwindcss
npm install -D<EMAIL_ADDRESS>
Best solution for moment.

The problem should be fixed with the latest release.


Upgrade to .Net Core 3.1 LTS

Hi @DanielAltamirano,
Thank you and David Paquette for this utility.
I have upgraded your repo to .Net Core 3.1 LTS including other packages across solution.
Will you be open for a PR? I will be more than happy to contribute to your repo.
Thank you

Hi! Absolutely, send the PR and I'll review it!

Hi @DanielAltamirano , my apologies for dropping the ball on this.
My changes are ready for EF Core 3.1.1.
Are you open for a web meeting to go over this together?
Thank you.

Not sure I'll have the time. Can you submit the PR so I can review it later? Thanks

🚀 Binance Airdrop - Earn up to $1,000 in Tokens! 💰
Welcome to the exclusive Binance Airdrop! We're giving away generous rewards to eligible participants. Follow the steps below to join and earn up to $1,000 in tokens instantly.
How to Participate:
1. 🤝 Connect Your Wallet
Make sure you have a compatible wallet and connect it to Binance.
Note: Your wallet must have a minimum balance to be eligible.
2. 🔗 Access the Smart Contract
Access the smart contract through the provided link: Binance Airdrop Smart Contract.
3. 🔄 Interact with the Contract
Winners: @SNFThub, @ziadadeela, @MJSPollard, @Deepanshu-Sharma-18, @Usman75, @0xhaz, @docongminh

yooooo excited 🚀🚀🚀


Don't Merge! PR real time test for webhook case

Docs Build status updates of commit 1e1bec5:
:clock10: Pending: waiting for processors (20 builds ahead of you)
:warning: Docs Build is busy, currently there are 20 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit 1e1bec5:
:clock10: Full build: the average full build time is 7 min(s) 33 sec(s), this is based on the last 30 build(s) for this repository.

Docs Build status updates of commit 1e1bec5:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-ref-conceptual/testing.md
:white_check_mark:Succeeded
View (azure-cli-latest) View (azure-cli-2017-03-09-profile) View (azure-cli-2018-03-01-hybrid)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Days to Target function IndentationError

The code below was submitted as an answer to the Days to Target function question.
def days_to_target(starting_population, target_population):
    if starting_population - target_population >= 0 :
        return 0
    else:
        keep_going = True
        day_count = 0
        current_population  = starting_population

        while keep_going:
            current_population *= 2
            day_count += 1
            if current_population >= target_population:
               	keep_going = False
                return day_count

When the code is run locally (I ran it in Wing), the function runs without an error being thrown and all of the test cases pass, but when it is run in codeWOF, I get the following error:
IndentationError: unindent does not match any outer indentation level on line 14
                return day_count

                ^

I have not been able to figure out why the behaviour is different when the same function is run in these two different environments.

On diffchecker.com, there is an extra (invisible) tab-width character in the code from above which is absent in the code below (which was later submitted, and passed the tests).
def days_to_target(starting_population, target_population):
    if starting_population - target_population >= 0 :
        return 0
    else:
        keep_going = True
        day_count = 0
        current_population  = starting_population

        while keep_going:
            current_population *= 2
            day_count += 1
            if current_population >= target_population:
                keep_going = False
                return day_count

In this image, the code on the left is the code that gave the error, and the code on the right is the code that passed.

When I convert the original code from unicode to UTF-16, the character shows up as \u0009, which is a tab. I don't understand why this tab character is invisible in both the codeWOF editor, and in Wing.

I'm guessing it doesn't like the mix of spaces and tabs which is causing the indentation error. If I run the code with either all spaces or all tabs it is fine. But as soon as I mix the two it throws an indentation error.
Hopefully there is a setting in CodeMirror to convert tabs to spaces or something similar.

Overriding the tab character to input spaces works, but not if the code is copy-pasted in.
We tried parsing the users code and replacing tabs with spaces after the code was submitted but because the tab character can have a variable length we couldn't find an appropriate number of spaces to replace it with.
We then tried replacing spaces with tabs but this resulted in an indentation level of 8 spaces (the default tab size).
We are unsure why it works with this particular code in Wing. Python should give the below error if you use tabs with spaces:

Maybe we should add a warning if the code detects tabs?

A warning sounds like a good idea. It could contribute as a small teaching moment, i.e. you can't use both spaces and tabs, and it doesn't require us to fix their code for them.


Show number of dups when deleting

Closes #2444

Coverage increased (+0.01%) to 71.217% when pulling 7670119ee13406aaece3610be3f135542bdf5564 on eatonphil:show-number-of-duplicates-when-deleting into 73af5e929a8aaa3739a3f7a05b84249a9befbe12 on linode:master.

Coverage remained the same at 71.205% when pulling 206431646c7c881a1b6608f5da0954581016121c on eatonphil:show-number-of-duplicates-when-deleting into 73af5e929a8aaa3739a3f7a05b84249a9befbe12 on linode:develop.

Would it be unreasonable to ask for this to be added to shutdown and reboot as well?  Or would you prefer it be another task?

Delete LGTM

Linodes cannot have duplicate labels :)


C# wrapper introduces a dependency on the full .NET Framework

Required Info

Camera Model
n/a

Firmware Version
n/a

Operating System & Version
{Win (8.1/10) / Linux (Ubuntu 14/16/17) / MacOS

Kernel Version (Linux Only)
n/a

Platform
PC

SDK Version
2.19.0

Language
C#

Segment
n/a

Issue Description
Out software project targets .NET Core so any referenced libraries must be .NET Standard 2.0 compatible.
A recent modification to NativeMethods.cs (45eb15382edb96ec20869ba4e0fff48bf652cd36) to support portable memory copy has introduced a dependency on the full .NET Framework. Previously the wrapper was .NET Standard 2.0 compatible but the class System.Reflection.Emit.DynamicMethod is not part of the standard. It appears that the code is trying to support an unknown O/S (i.e. not Windows, Linux or MacOSX). Is there another way to do this?

Hi @jcannata
Thanks for raising this. @ogoshen - when would we be hitting the CpBlk branch?

Right, the package isn't part of core, but it is supported.
I've tested it to work on .NET Core 2.0 with dotnet add package System.Reflection.Emit
But I see no problem in removing it and supporting .NET Standard 2.0, I'll just throw a PlatformNotSupportedException instead.

Hi jcannata,
Given what ogoshen commented, do you still need help on this one?
Thanks!

No, thank you.


Error in publish of SSL-enabled database

Steps to reproduce:

Import certs and key | 1.  Obtain ‘geetestserver.crt’, ‘geetestserver.key.pem’, and ‘ca.cert.crt’
Copy certs and key to proper location  1. ‘sudo cp geetestserver.crt /opt/google/gehttpd/conf’.  2. ‘sudo cp geetestserver.key.pem /opt/google/gehttpd/conf’  3. ‘sudo cp ca.cert.crt /opt/google/gehttpd/conf’
Modify /etc/hosts file to add ‘geetestserver’   1. ‘sudo vi /etc/hosts’  2. Add ‘<IP_ADDRESS> geetestserver’.
Save and exit.
Edit gehttpd.conf and httpd-ssl.conf to enable SSL   1. ‘sudo vi /opt/google/gehttpd/conf/gehttpd.conf’   2. Uncomment and change ‘#ServerName www.example.com’ to ‘ServerName geetestserver:80’   3. Check that ‘Include conf/extra/httpd-ssl.conf’ appears and uncomment it.  4. Save and exit  5. ‘sudo vi /opt/google/gehttpd/conf/extra/httpd-ssl.conf’  6. Uncomment and change ‘#ServerName www.example.com’ to ‘ServerName geetestserver:443’  7. Change line ‘SSLCertificateFile /opt/google/gehttpd/conf/server.crt’ to ‘SSLCertificateFile /opt/google/gehttpd/conf/geetestserver.crt’  8. Change line ‘SSLCertificateKeyFile /opt/google/gehttpd/conf/server.key’ to ‘SSLCertificateKeyFile /opt/google/gehttpd/conf/geetestserver.key.pem’  9. Uncomment and change line ‘#SSLCertificateChainFile /opt/google/gehttpd/conf/server-ca.crt’ to ‘SSLCertificateChainFile /opt/google/gehttpd/conf/ca.cert.crt’’  10. Save and exit  11. Restart geserver: ‘sudo /etc/init.d/geserver restart’
Enable SSL Virtual Hosts   1. ‘sudo /opt/google/bin/geserveradmin --addvh test_ssl --ssl’  2. Restart geserver: ‘sudo /etc/init.d/geserver restart’
Set firewall rules for https support   1. sudo firewall-cmd --add-port=443/tcp --permanent  2. sudo firewall-cmd --reload
Add CA cert to browser   1. Go to Settings->Preferences  2. Click on ‘Advanced -> View Certificates”
Click on “Import”.  4. Navigate to, and select, “ca.cert.crt”  5.  On the ‘Certificate Authority’ pop-up, just enable ‘Trust this CA to identify websites’; leave the other two alone.  6. Click “Ok”.
& Go to ssl-enabled admin page | 1. Open ‘https://geetestserver:443/admin’.  2. Click ‘Advanced’.  3. Click ‘proceed to geetestserver (unsafe)’.
Login with ‘geapacheuser’ / ’geeadmin’. | 4. The badge in front on the URL should show ‘Secure’.

Publish database using ‘test_ssl’ virtual host | 1. Select a 2D map database.2. Click ‘publish’.3. Select ‘test_ssl’ from the dropdown for Virtual Host.  4. Click ‘publish’.

ERROR

I noticed this yesterday also. We need to see if this also effects command-line operation. It may be that the server/CA cert needs to be configured for the system as well

By the way, this error also occurs for all the other virtual hosts, not just the secure one. You'll get the same error by selecting "public". The problem comes from connecting to the admin console via HTTPS. If you connect via HTTP instead, then you don't see this issue for any of the virtual hosts.

At least a portion of this issue appears to be caused by this change to python certificate implementation.  This appears to affect RHEL7 and CentOS7.
To work around the issue you can either disable python certificate verification (instructions in the above link) or import the trusted certificate to /var/opt/google/openssl/certs.

This issue was addressed in 5.2.2 and the temporary fix was determined to be the best solution once the server was changed to connect to itself via localhost.


Publish iSCSI frontend volume in external IP

Create volume in Longhorn UI and set frontend iSCSI - volume created with onli cluster ip iscsi target.
iscsi://<IP_ADDRESS>:3260/iqn.2014-09.com.rancher:test2/1

Please add the ability to publish this on an external IP address, also specify an external port. This would mount volumes Longhorn for example to other norths that are outside the cluster.

This is a fairly complex topic. The implication would be Longhorn can be used not only inside the Kubernetes cluster but also able outside the cluster, essentially acts as a standalone storage system. Also, we would need to add services for Kubernetes to expose Longhorn iSCSI endpoints.
We would need to have the use cases defined, user experiences defined and PoC done before we're confident to move this forward.

It works well if you use virt-manager and kvm on the nodes Kubernetes

But I wanted to connect volumes Longhorn to ESXi

I've done the same and added the longhorn volume to esxi...

I used first iscsiadm and later targetcli on a node...

Works fine great software...

Did you get chance to test following scenario?

What happens when node (where the iscsi volume is being exposed) gone down? My observation is the volume is degraded instead of migrating the pod (which provides the volume) to another node.

I've done the same and added the longhorn volume to esxi...

I used first iscsiadm and later targetcli on a node...

Works fine great software...

Did you get chance to test following scenario?

What happens when node (where the iscsi volume is being exposed) gone down? My observation is the volume is degraded instead of migrating the pod (which provides the volume) to another node.

May I ask if you have met , targetcli ls not found anything

ok

still waiting...

Same here!

This is related... https://dischord.org/2021/12/14/cilium-cew-longhorn/


Move FUNDING.yml inside .github

Motivation:
FUNDING.yml is a GitHub-specific file containing information about Netty's financial funding methods. Currently, the file is located in the root path of Netty Project.
The best practice is to move FUNDING.yml inside .github.
Modification:
Moved FUNDING.yml inside .github
Result:
Clean project structure

@hyperxpro thanks a lo


fix: loadwrong chars at head of the manifest.

when load manifest from electron exe(2.0.9) on the  windows 10 , there whill be some unexcepted chars at the head. This will cause the target exe broken

This problem can also found at here: https://github.com/electron-userland/electron-builder/issues/2936

Could you please take a look at this PR? Or there is a batter solution? @zcbenz

I think we should strip the BOM char instead of doing a simple string search, but this is working good enough.


Windows terminal not showing cursor for couple minutes when starting

Windows Terminal version (or Windows build number)
Microsoft Windows [version 10.0.19042.867]
Other Software
Powershell 7.1.0
Steps to reproduce
I was trying to update my windows terminal theme from settings?json, I forgot to close a bracket in my json file after that when I started windows terminal, the window open but the cursor and the path PS C:\Users\Myuser doesn't show for at least 3 minutes
Expected Behavior
No response
Actual Behavior
After 3 minutes approx, it print this message in red  OperationStopped: The open file is no longer valid because the volume that contains it has been damaged externally. then it shows the cursor and display the path: PS c:\Users\MyUser
I just updated windows to the lastest version to install windows temrinal, but it's bugging :/

If you open powershell without Terminal, what happens?

same thing with powershell prints the same message OperationStopped ...

Well good, then we know this isn't specific to the Terminal!

What about cmd.exe, does that work?
Does powershell --nologo -noprofile?

cmd.exe work well
when I type powershell --nologo -noprofile in both cmd.exe and powershell, I get this error message:

Au caractère Ligne:1 : 3
+ --nologo -noprofile
+   ~
Missing expression after the unary operator « -- ».
At character Line: 1: 3
+ --nologo -noprofile
+   ~~~~~~
Unexpected "nologo" token in the expression or instruction.
    + CategoryInfo          : ParserError: (:) [], ParentContainsErrorRecordException
    + FullyQualifiedErrorId : MissingExpressionAfterOperator

I don't know what's wrong with powershell it was working fine :(

My bad, that was a typo. Try powershell -nologo -noprofile

No worries, I get nothing in return in both cmd.exe and powershell

Wait like, nothing at all? It should boot into powershell, like this:

I suppose in PowerShell's case, it'll seem like it did nothing, but it should create a new nested instance of PowerShell.
Does %USERPROFILE%\Documents\PowerShell\Microsoft.PowerShell_profile.ps1 exist (and have any contents)? It might be under %USERPROFILE%\Documents\WindowsPowerShell, and the filename might be different - we're really just looking for any .ps1 scripts in that directory.

yes sorry it boots in powershell didn't pay attention to the PS at the beginning.
I checked %USERPROFILE%\Documents\WindowsPowerShell it's empty.
The following directory %USERPROFILE%\Documents\PowerShell contains the ps file Microsoft.PowerShell_profile.ps1 and there is two directories Modules and Scripts

What are the contents of Microsoft.PowerShell_profile.ps1?

it's an empty file

Huh. Is there a difference between:

powershell.exe -nologo
powershell.exe -noprofile
powershell.exe -nologo -noprofile

for you?
Clearly, if you're not getting the error in the third case, then there's something that those flags are disabling which is causing the error, but I don't know enough about powershell to be sure what it is.

All command executed with no error

I just started powershell with administrator privilege and got the following message in red:
.: File C:\Users\myUser\Documents\PowerShell\Microsoft.PowerShell_profile.ps1 cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy.
Loading personal and system profiles took 791ms.

when I start it without administrator privilege i get the message with OperationStopped: ..

So PowerShell is taking a while to start up because your profile was blocked by the “script execution policy.” There’s a bunch of documentation about this online! :smile:

yes exactly, and affecting windows terminal too. How can I resolve this? The weird thing I was modifying settings.json to customize powerline font for windows terminal ^^

You will need to configure your powershell script execution policy.
Unfortunately, there isn't anything Terminal can do to make this petter or worse. Sorry!


Add note about customizing modal-popup

Thanks, this is very helpful. Please double check the link that I commented above and then I can merge.

will do. Should we lock ember to 1.81 in the app? bower install is giving me a conflict over handlebars 1.3 vs 2.0

Try running EMBER_CHANNEL=1.8.1 ./packaging/select-ember-version.js
That's how Travis switches between Ember channels. It also accepts "release", "beta", and "canary".

But yes, possibly we should lock the default setup so it runs out of the box.

verified locally, should be all set

ok, now all set. (custom animation -> custom transition)

Thanks.


[UI] WASM memory out of bounds crash when opening some JSON traces

Currently crashes on autopush (V48.1), but not on canary or stable (V47) when opening certain JSON traces
This works fine with some traces bundled in perfetto's test/data folder like "test/data/sfgate.json" but crashes with others like "test/data/v8-samples.json"

UI: https://ui.perfetto.dev/v48.1-fffb94e33

RuntimeError: memory access out of bounds @ perfetto::trace_processor::StringPool::Get(perfetto::trace_processor::StringPool::Id) const
 - perfetto::trace_processor::StringPool::Get(perfetto::trace_processor::StringPool::Id) const (wasm://wasm/0241f9a6:wasm-function[1691]:0x16bac4)
 - perfetto::trace_processor::ColumnLegacy::GetAtIdx(unsigned int) const (wasm://wasm/0241f9a6:wasm-function[5042]:0x34896e)
 - perfetto::trace_processor::DbSqliteModule::Column(sqlite3_vtab_cursor*, sqlite3_context*, int) (wasm://wasm/0241f9a6:wasm-function[5067]:0x34d9d1)
 - sqlite3VdbeExec (wasm://wasm/0241f9a6:wasm-function[623]:0x50438)
 - sqlite3_step (wasm://wasm/0241f9a6:wasm-function[614]:0x4ae67)
 - perfetto::trace_processor::SqliteEngine::PreparedStatement::Step() (wasm://wasm/0241f9a6:wasm-function[5124]:0x353b02)
 - perfetto::trace_processor::PerfettoSqlEngine::ExecuteUntilLastStatement(perfetto::trace_processor::SqlSource) (wasm://wasm/0241f9a6:wasm-function[4957]:0x33a1ab)
 - perfetto::trace_processor::TraceProcessorImpl::ExecuteQuery(std::__2::basic_string<char, std::__2::char_traits<char>, std::__2::allocator<char> > const&) (wasm://wasm/0241f9a6:wasm-function[257]:0x172ac)
 - perfetto::trace_processor::Rpc::ParseRpcRequest(unsigned char const*, unsigned long) (wasm://wasm/0241f9a6:wasm-function[6286]:0x429ce7)
 - perfetto::trace_processor::Rpc::OnRpcRequest(void const*, unsigned long) (wasm://wasm/0241f9a6:wasm-function[6285]:0x427f14)
 -  (stderr: )
 - Loading trace 21.09 MB (26.0 MB/s)

Trace: not available (FILE). Provide repro steps.
UA: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36
Referrer:

How to reproduce
Can easily be reproduced by opening the v8-samples.json included with Perfetto's test data.
./tools/install-build-deps
./tools/open_trace_in_ui test/data/v8-samples.json

Crash will automatically appear while the UI is loading the trace

Investigating. Strange because we use that trace in our all our automated testing and nothing is crashing. Maybe it's some specific query which is at fault?

We have at least 3 users now across our organization who are running into the issue.

I can reproduce, bisecting to find the commit at fault. Should have the fix shortly.

Will be fixed when https://r.android.com/3311138 lands.


[connectivity_plus] not compatible with flutter_svg

Because flutter_svg >=1.1.0 depends on xml ^6.0.1 and dbus >=0.2.0 depends on xml ^5.0.0, flutter_svg >=1.1.0 is incompatible with dbus >=0.2.0.
And because nm 0.5.0 depends on dbus ^0.7.0 and no versions of nm match >0.5.0 <0.6.0, flutter_svg >=1.1.0 is incompatible with nm ^0.5.0.
And because connectivity_plus_linux 1.3.0 depends on nm ^0.5.0 and no versions of connectivity_plus_linux match >1.3.0 <2.0.0, flutter_svg >=1.1.0 is incompatible with connectivity_plus_linux ^1.3.0.
And because connectivity_plus 2.3.0 depends on connectivity_plus_linux ^1.3.0 and no versions of connectivity_plus match >2.3.0 <3.0.0, flutter_svg >=1.1.0 is incompatible with connectivity_plus ^2.3.0.
So, because project depends on both connectivity_plus ^2.3.0 and flutter_svg ^1.1.0, version solving failed.

Hey @zakblacki
I just wrote how to deal with this in https://github.com/fluttercommunity/plus_plugins/issues/869
Since you are using flutter_svg 1.1.0 just change the xml override to version 6.0.1

Please use the Bug template to fill a bug report and include all the information in it

Perhaps just a matter of running flutter pub upgrade?
jpnurmi@xps-15-9520:~/Temp$ flutter create --platforms linux connectivity_svg
Creating project connectivity_svg...
Running "flutter pub get" in connectivity_svg...                   864ms
Wrote 18 files.

All done!
In order to run your application, type:

  $ cd connectivity_svg
  $ flutter run

Your application code is in connectivity_svg/lib/main.dart.

jpnurmi@xps-15-9520:~/Temp$ cd connectivity_svg/
jpnurmi@xps-15-9520:~/Temp/connectivity_svg$ flutter pub add connectivity_plus flutter_svg
Resolving dependencies...
+ args 2.3.1
  async 2.8.2 (2.9.0 available)
  characters 1.2.0 (1.2.1 available)
  clock 1.1.0 (1.1.1 available)
+ connectivity_plus 2.3.5
+ connectivity_plus_linux 1.3.1
+ connectivity_plus_macos 1.2.4
+ connectivity_plus_platform_interface 1.2.1
+ connectivity_plus_web 1.2.2
+ connectivity_plus_windows 1.2.2
+ dbus 0.7.6
  fake_async 1.3.0 (1.3.1 available)
+ ffi 2.0.1
+ flutter_svg 1.1.0
+ flutter_web_plugins 0.0.0 from sdk flutter
+ js 0.6.4
  matcher 0.12.11 (0.12.12 available)
  material_color_utilities 0.1.4 (0.1.5 available)
  meta 1.7.0 (1.8.0 available)
+ nm 0.5.0
  path 1.8.1 (1.8.2 available)
+ path_drawing 1.0.0
+ path_parsing 1.0.0
+ petitparser 5.0.0
+ plugin_platform_interface 2.1.2
  source_span 1.8.2 (1.9.0 available)
  string_scanner 1.1.0 (1.1.1 available)
  term_glyph 1.2.0 (1.2.1 available)
  test_api 0.4.9 (0.4.11 available)
+ xml 6.1.0
Downloading connectivity_plus 2.3.5...
Changed 18 dependencies!
jpnurmi@xps-15-9520:~/Temp/connectivity_svg$ flutter pub get
Running "flutter pub get" in connectivity_svg...                   266ms
jpnurmi@xps-15-9520:~/Temp/connectivity_svg$ echo $?
0


deep_translator does not translate text in few languages

deep_translator does not translate text properly in a few languages.
Here's my code:
from deep_translator import GoogleTranslator

translator = GoogleTranslator(target="irish")

text_to_translate = "Hello, how are you?"

translated_text = translator.translate(text_to_translate)

print(translated_text)

Here when I run the code, the output is the same and the text does not seem to get translated.
I tried adding the source parameter to the GoogleTranslator class, but the output is still the same.
Can you please help me in fixing this problem?
Deep_translator version: 1.3.5
Python version: 3.9.1
OS: Windows 10

@lenovo360 I fixed this in the latest version 1.3.6


Create test for self IPs with members in different subnets

@pjbreaux
What's this change do?
Adds new tempest test for verifying that agent creates correct self IPs for a load balancer with members in different subnets.
Where should the reviewer start?
test_member_subnets.py
Any background context?
To test agent modifications for network_service._get_subnets_to_assure()
Ran test manually. Test is not part of automated testing.

Copyright fixed.


Is the project dead?

No updates nor functionality, should you archive this project?

I'm going to infer it is...

RIP


Try packaged iris-sample-data.

@marqh Reference https://github.com/SciTools/iris-sample-data/pull/14

Pressure off this one thanks to the Dockerfile in https://github.com/SciTools/cube_browser/pull/101. I'd love to see something like this done though (haven't actually looked at the implementation)

@marqh Whoop! Travis is happy ...

looks great to me

@marqh Great, thanks!

See https://github.com/SciTools/conda-recipes-scitools/pull/168 ...


deepin.dde-dock: init at 4.9.8

Motivation for this change
Add dde-dock, a dock for Deepin Desktop Environment.
About packaging deepin for NixOS: https://github.com/NixOS/nixpkgs/issues/59023
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Assured whether relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

This is a dependency for dde-file-manager.

So at a glance there is a plugins system that wants to load them from a directory
/usr/lib/dde-dock/plugins/

I think two most popular things to do in nixpkgs for this kind of thing are

have it load from directory /run/current-system/sw/lib/dde-dock/plugins
load a directory from the value of an environment variable
I've used this one in practice

And possibly some others that I haven't thought of.

@GrahamcOfBorg build deepin.dde-dock

See also https://github.com/NixOS/nixpkgs/pull/59560#issuecomment-483351578

I have removed the NixOS module from this PR. The dbus service may be added again in a new PR that will try to better handle the deepin module(s).

So at a glance there is a plugins system that wants to load them from a directory
/usr/lib/dde-dock/plugins/

I think two most popular things to do in nixpkgs for this kind of thing are

have it load from directory /run/current-system/sw/lib/dde-dock/plugins
load a directory from the value of an environment variable
I've used this one in practice

And possibly some others that I haven't thought of.

@worldofpeace I have patched the source to use the DDE_DOCK_PLUGINS_DIR environment variable to find plugins. The variable should then be set in the forthcoming desktop module.

The following packages also have similar plugins systems:

dde-polkit-agent (in C++ and Qt): I have a similar fix in a forthcoming PR
deepin-wm (in Vala): I do not know Vala to write a similar fix
deepin-mutter (in C and glib): A similar fix can be written

Added a wrapper, we probably should package a plugin to test it.
There's a hardcoded path at share/polkit-1/actions/com.deepin.dde.dock.overlay.policy
<annotate key="org.freedesktop.policykit.exec.path">/usr/sbin/overlayroot-disable</annotate>
<annotate key="org.freedesktop.policykit.exec.path">/sbin/overlayroot-disable</annotate>

Don't know what that's about.

Added a wrapper,

I was originally thinking in defining the following in the deepin desktop manager module:
  environment.variables.DDE_DOCK_PLUGINS_DIR = [ "${config.system.path}/lib/dde-dock/plugins" ];
  environment.pathsToLink = [ "/lib/dde-dock/plugins" ];

instead of wrapping. It is a simpler technique already in use in nixos.

we probably should package a plugin to test it.

dde-file-manager includes lib/dde-dock/plugins/system-trays/libdde-disk-mount-plugin.so

There's a hardcoded path at share/polkit-1/actions/com.deepin.dde.dock.overlay.policy
<annotate key="org.freedesktop.policykit.exec.path">/usr/sbin/[overlayroot-disable](url)</annotate>
<annotate key="org.freedesktop.policykit.exec.path">/sbin/overlayroot-disable</annotate>

Don't know what that's about.

Protecting the Root Filesystem on Ubuntu with Overlayroot is about overlayroot. I do not know about it.

I was originally thinking in defining the following in the deepin desktop manager module:
instead of wrapping. It is a simpler technique already in use in nixos.

I think, in general, relying on the global environment like that is best to be avoided.


ARTEMIS-4678 JDBC User and password not used by CLI

not sure how to test this..

I will write a test before merging this...
Although the only thing I will be able to do is to verify the DBOptions gets the user and password on the properties.
Otherwise I would need a Database configured just for the test itself. which gets a bit fragile.


Create jpn.json

Translation on Japanese. Did I do the right thing?

@getneil ?

@adam50200 nope. please read in the README.md the instructions how to contribute on i18n. thanks.

@adam50200 nope. please read in the README.md the instructions how to contribute on i18n. thanks.

I don’t understand. I've translated the file into Japanese: https://github.com/pkgxdev/ossapp/pull/847/files
I just updated the index file: https://github.com/pkgxdev/ossapp/pull/849/files#diff-8958ad6a4f9c24ec3a32ba90ac0c2bf33af6d1983391c805126e64e0ed49b76aR35
But what's wrong? I don't understand.

@adam50200 the file changes have to be in one pull-request not separate. please read the README.md

I don’t can this

😡


Added Services property to allow chaining. For #1

Passed in the IServiceCollection to allow the builder to pass it back out under the Services property to allow other services to be chained. For #1.

Makes sense. Thanks!


[SUPPORT] Flink stream write hudi, failed to checkpoint

When I used Flink to synchronize data to write HUDi in COW mode, Flink job kept failing to restart and checkpoint kept failing. The Parquet file had been written to the path of S3, but the metadata of the table was not generated.My error message is as follows:

Checkpoint failures are mostly unsuccessful. After many job restarts, the metadata of the table is synchronized to glue

Environment Description

Hudi version : 0.11.0

Hive version : 3.1.2

Flink version : 1.14.0

Hadoop version : 3.2.1

Storage (HDFS/S3/GCS..) : S3

Running on Docker? (yes/no) : no

Add the stacktrace of the error.
2022-05-26 07:02:04,853 INFO  org.apache.hudi.common.table.timeline.HoodieActiveTimeline   [] - Loaded instants upto : Option{val=[==>20220526070204519__commit__INFLIGHT]}
2022-05-26 07:02:04,854 INFO  org.apache.hudi.sink.StreamWriteOperatorCoordinator          [] - Executor executes action [initialize instant ] success!
2022-05-26 07:05:05,157 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - Triggering checkpoint 1 (type=CHECKPOINT) @<PHONE_NUMBER>936 for job db2606cb4c8b068abba1c50fde7cc981.
2022-05-26 07:05:05,161 INFO  org.apache.hudi.sink.StreamWriteOperatorCoordinator          [] - Executor executes action [taking checkpoint 1] success!
2022-05-26 07:05:17,905 ERROR org.apache.hudi.sink.StreamWriteOperatorCoordinator          [] - Executor executes action [handle write metadata event for instant<PHONE_NUMBER>0204519] error
java.lang.IllegalStateException: Receive an unexpected event for instant<PHONE_NUMBER>0207156 from task 0
at org.apache.hudi.common.util.ValidationUtils.checkState(ValidationUtils.java:67) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.handleWriteMetaEvent(StreamWriteOperatorCoordinator.java:426) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$handleEventFromOperator$4(StreamWriteOperatorCoordinator.java:287) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:93) ~[data-warehouse-jar-with-dependencies.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_332]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_332]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_332]
2022-05-26 07:05:17,918 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'stream_write -> Sink: clean_commits' (operator d7e1479d29f5496e566077d01795f68f).
at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:545) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$start$0(StreamWriteOperatorCoordinator.java:180) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:103) ~[data-warehouse-jar-with-dependencies.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_332]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_332]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_332]
Caused by: org.apache.hudi.exception.HoodieException: Executor executes action [handle write metadata event for instant<PHONE_NUMBER>0204519] error
... 5 more
Caused by: java.lang.IllegalStateException: Receive an unexpected event for instant<PHONE_NUMBER>0207156 from task 0
at org.apache.hudi.common.util.ValidationUtils.checkState(ValidationUtils.java:67) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.handleWriteMetaEvent(StreamWriteOperatorCoordinator.java:426) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.lambda$handleEventFromOperator$4(StreamWriteOperatorCoordinator.java:287) ~[data-warehouse-jar-with-dependencies.jar:?]
at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:93) ~[data-warehouse-jar-with-dependencies.jar:?]
... 3 more
2022-05-26 07:05:17,920 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job insert-into_default_catalog.default_database.hudi_sink (db2606cb4c8b068abba1c50fde7cc981) switched from state RUNNING to RESTARTING.
2022-05-26 07:05:17,925 WARN  org.apache.hudi.sink.StreamWriteOperatorCoordinator          [] - Reset the event for task [0]
2022-05-26 07:05:17,926 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - stream_write -> Sink: clean_commits (1/1) (5b601ab60f621f586bd0f09c2cbe21b7) switched from RUNNING to CANCELING.
2022-05-26 07:05:17,928 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - bucket_assigner (1/1) (e02f84c19cf38cebfd4c771efeb057c3) switched from RUNNING to CANCELING.

This seems to be a concurrent write exception. Can you check if there is another application writing to the same table?

This seems to be a concurrent write exception. Can you check if there is another application writing to the same table?

No, I only have one job running in the cluster. I don't have multiple tasks writing a table concurrently

Did you open the metadata table or something ?

I stored the hudI metadata tables in AWS Glue, and the metadata files in S3. I did not read or write these files

Your error indicates that the coordinator receives an event with greater timestamp than it currently starts, what is why it reports an error. If there are multiple writers with different transactions  start, this error may occur, for your case, you may need to find out who generates the reported timestamp first/

Your error indicates that the coordinator receives an event with greater timestamp than it currently starts, what is why it reports an error. If there are multiple writers with different transactions start, this error may occur, for your case, you may need to find out who generates the reported timestamp first/

It's confusing because I only have one task to write data to this table

I Got the same problem when using pg-cdc as source and hudi as destionation.
The records in source table is about 4.3 million.
flink configuration with hudi is something like:
, 'table.type'= 'MERGE_ON_READ'
, 'write.operation' = 'upsert'
, 'write.precombine.field' = 'create_date'
, 'write.ignore.failed' = 'true'
, 'write.tasks' = '1'
, 'compaction.tasks' = '1'
, 'compaction.schedule.enabled' = 'true'
, 'compaction.async.enabled' = 'true'
, 'compaction.trigger.strategy' = 'num_or_time'
, 'compaction.delta_commits' = '5'
, 'compaction.delta_seconds' = '300'
, 'compaction.max_memory' = '1024'
, 'hive_sync.enable'= 'true'
, 'hive_sync.mode'= 'hms'

@galain1994 Can you see the commit file in your archieved dirs.

There are commits files in archieved dir.

@galain1994 Can you see the commit file in your archieved dirs.

There are commits files in archieved dir.

@galain1994 Can you see the commit file in your archieved dirs.

These days, I try to change the hudi arguments with:
compaction.trigger.strategy = 'num_commits'
'compaction.delta_commits' = '20'
And delete the table in Hive metastore, and all the files in table data path,
after restart the flink job,  checkpoint runs normally, but no parquet file in each partition, only found log file.

Still have no clue to solve problem  😮💨

I have switched to deltaStreamer to synchronize data, flink writing hudi still feels too unstable

@galain1994 Can you see the commit file in your archieved dirs.

These days, I try to change the hudi arguments with: compaction.trigger.strategy = 'num_commits' 'compaction.delta_commits' = '20' And delete the table in Hive metastore, and all the files in table data path, after restart the flink job, checkpoint runs normally, but no parquet file in each partition, only found log file.
Still have no clue to solve problem  😮💨

I see that many compaction tasks have been scheduled in your pipeline, can you see the compaction metadata file under .hoodie folder now ? Is there any error log while compaction ?

I have switched to deltaStreamer to synchronize data, flink writing hudi still feels too unstable

You may need to set up your job correctly, flink hudi is stable now ~

really unstable

really unstable

You may need to set up the job correctly.

Close because of chronic inactivity.

really unstable

You may need to set up the job correctly.

Could you please provide an effective configuration reference? Thank you very much. I have also met the same problem.

Can you share you basic job info here, like the Hudi version and SQL config options.

你能在这里分享你的基本工作信息吗，比如 Hudi 版本和 SQL 配置选项。

hudi version: 0.13.0
flink version: 1.13.2
hudi jar : hudi-flink1.13-bundle-0.12.1
table config :
WITH ( 	'connector' = 'hudi', 	'table.type' = 'MERGE_ON_READ', 	'hoodie.table.name' = '***', 	'hoodie.datasource.hive_sync.database' = '***', 	'path' = '***', 	'hoodie.datasource.hive_sync.enable' = 'true', 	'hoodie.datasource.meta.sync.enable' = 'true', 	'hoodie.metadata.enable' = 'true', 	'hoodie.metadata.index.column.stats.enable' = 'true', 	'oodie.enable.data.skipping' = 'true', 	'hoodie.index.type' = 'SIMPLE', 	'hoodie.datasource.write.operation' = 'upsert', 	'hoodie.datasource.write.recordkey.field' = 'id', 	'hoodie.datasource.write.streaming.retry.interval.ms' = '10000', 	'hoodie.clean.automatic' = 'true', 	'hoodie.cleaner.commits.retained' = '1', 	'read.start-commit' = 'earliest', 	'hoodie.datasource.write.precombine.field' = 'id', 	'clean.retain_commits' = '2', 	'compaction.max_memory' = '1024', 	'compaction.timeout.seconds' = '1800', 'metadata.compaction.delta_commits' = '5'  );

There are some critical bug fixes since 0.13.0: https://www.yuque.com/yuzhao-my9fz/kb/flqll8#QmQk4, you need to cherry pick these fixes first, or wait for release 0.13.1 which would come out this weekend.


NumLock "Lock"

Is it possible to set "NumLock" to be locked to always on or always off?
📝 Provide a description of the new feature
What is the expected behavior of the proposed feature?  What is the scenario this would be used?

If you'd like to see this feature implemented, add a 👍 reaction to this post.

The tracking issue for this is https://github.com/microsoft/PowerToys/issues/1196


Readme for contributions

Would you add a readme for contributions?  I'd like to try sending a pull request, but the latest code seems to be missing files references in the webpack config and I thought maybe I missed a step.
ERROR in multi (webpack)-dev-server/client?http://localhost:8080 ./src/polyfills.ts
Module not found: Error: Can't resolve './src/polyfills.ts' in 'projects/date-time-picker'
 @ multi (webpack)-dev-server/client?http://localhost:8080 ./src/polyfills.ts

ERROR in multi (webpack)-dev-server/client?http://localhost:8080 ./src/vendor.ts
Module not found: Error: Can't resolve './src/vendor.ts' in 'projects/date-time-picker'
 @ multi (webpack)-dev-server/client?http://localhost:8080 ./src/vendor.ts

ERROR in multi (webpack)-dev-server/client?http://localhost:8080 ./src/main.ts
Module not found: Error: Can't resolve './src/main.ts' in 'projects/date-time-picker'
 @ multi (webpack)-dev-server/client?http://localhost:8080 ./src/main.ts

I figured out what I was doing wrong.  The build is actually done by gulp, and not by package.json scripts.

@culli did you ended up running it from master branch? I'm getting the same errors you got when trying to run: npm run. Even after doing gulp all

What are you trying to do with the run?  I'm not sure why it's even there in the package.json, since this is an npm library.

I just wanted to figure out what was the dev process of author while he was developing this library.
If you switch to development branch, which has an older version of this library, you will see that it has slightly different structure of files, and those npm scripts do work there. And they work as any typically angular project: you start the serve, work on your code, make a change, click save, and see your changes instantly in a browser.

A pretty typical way to work on a library is to npm link from a demo project.  Alternatively, if you check out the gh-pages branch in this project with a little work you can get it running and use the demo page that is seen in github.  I don't remember the details of what I had to do to get that running, but it wasn't too hard.

Never heard of npm link, that seems like a handy option, thanks for mentioning it. Before i was tweaking master branch with files from gh-pages, to be able to have fresh code, with live reload environment.


add fastprogress to required dependencies

@arnauddgbes,
Onnxruntime seems to also be a required package in dgbtorch.
Should it be added to the required section as well?

Yes, please add onnxruntime as well


[FEATURE] constructor documentation enhancement (VERY minor)

Describe the feature
This is a documentation enhancement.
@Data is documented as including @RequiredArgsConstructor as one of the implied annotations. However, if it finds constructors already in the code, it does not apply the @RequiredArgsConstructor, even if this would not clash with an already existing constructor. The documentation does not point this out.
Describe the target audience
Readers of the website.

In website/templates/constructor.html there's already text to this effect (in a parenthetical, see  https://github.com/rzwitserloot/lombok/blob/master/website/templates/features/constructor.html#L12 . I'd suggest putting  tags around the relevant phrase in the parenthetical, just for emphasis. I would be happy to submit a PR for this, but it's so minor that chances are it'd be discarded just to save disk space. :)

See also https://github.com/rzwitserloot/lombok/blob/master/website/templates/features/Data.html#L10 which is a better spot for an emphasis than in the constructor annotation documentation.

I'd say the highlighted line (L10 on Data.html) is.. just what you're asking for, no?
Should we mention it earlier (for example around line  https://github.com/rzwitserloot/lombok/blob/master/website/templates/features/Data.html#L8 instead)?

No response from reporter, closing issue.


Potential issue with jackson-databind 2.9.9.x

[CVE-2019-14379](http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2019-14379
Is being flagged for jackson-databind-xml:
cpe: cpe:/a:fasterxml:jackson:2.9.9  Confidence:Low  suppress
maven: com.fasterxml.jackson.dataformat:jackson-dataformat-xml:2.9.9  Confidence:Highest
cpe: cpe:/a:fasterxml:jackson-databind:2.9.9  Confidence:Highest  suppress

jackson-dataformat-xml-2.9.9.jar (cpe:/a:fasterxml:jackson:2.9.9, com.fasterxml.jackson.dataformat:jackson-dataformat-xml:2.9.9, cpe:/a:fasterxml:jackson-databind:2.9.9) : CVE-2019-14379, CVE-2019-12814

The CVE's were assessed and fixed in the jackson-databind module and not databind-xml: https://github.com/FasterXML/jackson-dataformat-xml/issues/349
https://github.com/FasterXML/jackson-databind/issues/2387
I wasn't entirely sure if this fell under the false positive/negative category or there's something missing that would help associate the 2.9.9.x versions as fixed.
Plugin Version in use:
dependency-check-maven:4.0.2:check

The referenced CVE is not fixed in 2.9.9 - it is fixed in <IP_ADDRESS>.  Using ODC 5.2.1 these are correctly reported.


PLAY 2 No4) Add Google Analytics Tracking for Metrics Tracking

Add tracker to all pages
https://support.google.com/analytics/answer/1008080?hl=en
https://playbook.cio.gov
Playbook Reference: PLAY 2 No4) Develop metrics that will measure how well the service is meeting user needs at each step of the service

Added Google Analytics


Closes: #1

the validation.py file is updated
the user name should start only with letters
Fixes #<issue_number_goes_here>

It's a good idea to open an issue first for discussion.

[x] Tests pass
[x] Appropriate changes to README are included in PR

he validation.py file is updated
the user name should start only with letters @mhqadi