how this package could be used for aligning two 2D data (or two 2d cloud points )

I want to align two TSNE data using this package could you tell me how to use this package ?
from functools import partial
from scipy.io import loadmat
import matplotlib.pyplot as plt
from pycpd import affine_registration,rigid_registration(X, Y)
import numpy as np
import time

def visualize(iteration, error, X, Y, ax):
    plt.cla()
    ax.scatter(X[:,0] ,  X[:,1], color='red')
    ax.scatter(Y[:,0] ,  Y[:,1], color='blue')
    plt.draw()
    print("iteration %d, error %.5f" % (iteration, error))
    plt.pause(0.001)

def main():
    X = np.random.random((10, 2))  # 10 points in 2 dimensions
    Y = np.random.random((10, 2))  # 10 points in 2 dimensions
    fig = plt.figure()
    fig.add_axes([0, 0, 1, 1])
    callback = partial(visualize, ax=fig.axes[0])

    reg = rigid_registration(X, Y)
    reg.register(callback)
    plt.show()

main()

Hi Rebeen,
The issue is these two lines:
    X = np.random.random((10, 2))  # 10 points in 2 dimensions
    Y = np.random.random((10, 2))  # 10 points in 2 dimensions

You simply cannot register random points to each other. Registration implies correspondence and random points do not correspond to each other.
If you are just testing the code out, you can apply a known transformation to a random point cloud and see if the registration can recover it:
# Known transform (rotation + translation)
R = np.array([[0.866, -0.5], [0.5, 0.866]])
t = np.array([0.5 1.0])

# Source point cloud
Y = np.random.random((10, 2))  # 10 points in 2 dimensions

# Target point cloud
X = np.dot(R, Y) + np.tile(t, (np.shape(Y)[0], 1))

I  will check your code out but can I use it for align two Tsne data? do you think it works good for the two TSNE , of course the two tsne has some correspondence between them because they comes from the same data

My bad. The order of matrix multiplication for X = R * Y is X = np.dot(Y, R).
Other than providing working examples, e.g. examples/fishRigid2D.py, I do not know how else I can help you.

please can you help me to apply on my data the two TSNE data that are 2 D
yes know I got result for your data

If you do TY, R_reg, t_reg, s_reg = reg.register(callback) instead of reg.register(callback) (line 13), you can check the following to see if the registration has worked:

Does TY equal or close to X?
Are R_reg, t_reg and s_reg close to R, t and 1.0, respectively?

If this is true then registration works. I can’t debug a problem that does not exist.

this is the output of TY and X

They are equal, so the registration was successful.

this is all

I dont have any problem with this but my question is how to use this to align two TSNE(2d data) ?

If the transformation between two t-SNE point clouds can be modelled using rigid, affine or deformable transformations, then you can use rigid_registration, affine_registration or deformable_registration using the same approach that you just tried.
Does this make sense theoretically? I am not sure if the transformation between two t-SNE point clouds can be modelled as such. Then again I am not a machine learning expert.

the problem is I dont know about rigid_registration, affine_registration or deformable_registration . also I am confusing about the registration word , I think you meant align right ?

usually for alignment people use Procrustes analysis and Iterative closes point but I dont know about this algorithm

Rebeen you either need to take a course in point cloud registration or ask your graduate supervisor to help you with understanding underlying concepts. Unfortunately I do not have enough bandwidth to help you with your research.

This might be a good starting point: https://en.wikipedia.org/wiki/Point_set_registration
Or this survey paper: https://orca.cf.ac.uk/47333/1/ROSIN registration of 3d point clouds and meshes.pdf

Good luck with your research!

thank you


Use edx fork of slumber, circumventing unicode decoding bug.

XCOM-1606
@rlucioni @clintonb @feanil

:+1:
Starting a new build should get you a pass now that the commit needed here is available.

also it should help that i fixed my stupid syntax mistake from the previous attempt.

updated to force install of our edx release version.   good catch @clintonb .

:+1:

:+1:

@jimabramson third time's a charm. :+1:

:+1:


Crash in ParseAutoTypeId caused by json assertion when parsing NTR System.Com::IUnknown

Version and Platform (required):

Binary Ninja Version: > 3.4

ParseAutoTypeId inappropriately expects TypeId's to be json parsable, when these can be directly supplied by the user through the API. If you try to view a com type in the type browser it will cause binary ninja to crash.

Looks like rapidjson's parse method does not only return parseerror, it also throws a parseexception. It makes you wonder why the return value exists at all.


Doc: User namespace are disable by default in debian

We should leave a notice in the README about Debian hardening regarding userns.
To enable, we need to:
echo 1 > /proc/sys/kernel/unprivileged_userns_clone

and make it persistant using:
echo 'kernel.unprivileged_userns_clone=1' > /etc/sysctl.d/userns.conf

I'm also reading a similar path is available for newer kernel with a different switch.

We should leave a notice in the README about Debian hardening regarding userns.

I don't use Debian so it would be helpful if you make a PR adding a subsection to the requirements section of the README.


Docs are busted

When visiting https://docs.adfinis.com/ember-validated-form/ you just get a 404 message. When visiting docs.adfinis.com directly, you are presented with a nice "Hello World" message.

Docs can be directly accessed here.

Thanks, it looks like they have been restored! Closing out the issue.


feat: add readtree support for harness

Hey, I just made a Pull Request!
Add read tree support for harness url reader
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[x] Added or updated documentation
[x] Tests for new functionality and regression tests for bug fixes
[x] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 13 committers have signed the CLA.:white_check_mark: cjlee1:x: Rugvip:x: NitinRamnani:x: benjdlambert:x: cmoulliard:x: AmbrishRamachandiran:x: backstage-goalie[bot]:x: johanneswuerbach:x: joshjung:x: freben:x: vinzscam:x: renovate[bot]:x: kenzliangYou have signed the CLA already but the status is still pending? Let us recheck it.

merged in the main backstage repo


Github to local

Hi, i always start my docker containair like that :
#docker-compose.yml

meteor:
  image:  ulexus/meteor
  ports:
   - "80:80"
  links:
   - mongo
  environment:
   - REPO=https://github.com/...
   - ROOT_URL=http://<IP_ADDRESS>
mongo:
  image: mongo
  ports:
  - "27017:27017"

i would like to start my containair with my local app now. Can i create a git on the app directory and use it like repo=d:/path/to/myapp ? or i need an online git ?
if i cant use a local git what i need to add on the docker-compose.yml ?
when i try to just add
volumes:
    - .:/app

he stay bloqued  waiting for the connections on port 27017
ty, sorry for my really bad english.

I don't use Docker Compose, so I can only guess here.   The message would likely be from the mongo container and not the meteor container.  I presume the execution of your composed set pipes all of the output through a single stdout, so that message really only indicates that the mongo image was the last to write to stdout.  The mongo container should block on that.
So, my suggestion would be to look back through the logs and see if you can find the last few lines of the meteor container.  Note also that the npm install section of the entrypoint script can take several minutes to complete, during which time, nothing will be displayed.

ty for you're answer @Ulexus .
Really i understand nothing to the docker log maybe u can see something ...
2016-03-23T10:08:27.579+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db/diagnostic.data'
2016-03-23T10:08:27.582+0000 I NETWORK  [initandlisten] waiting for connections on port 27017
2016-03-23T10:08:27.582+0000 I NETWORK  [HostnameCanonicalizationWorker] Starting hostname canonicalization worker
2016-03-23T10:09:36.801+0000 I CONTROL  [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends
2016-03-23T10:09:36.801+0000 I FTDC     [signalProcessingThread] Shutting down full-time diagnostic data capture
2016-03-23T10:09:36.807+0000 I CONTROL  [signalProcessingThread] now exiting
2016-03-23T10:09:36.807+0000 I NETWORK  [signalProcessingThread] shutdown: going to close listening sockets...
2016-03-23T10:09:36.807+0000 I NETWORK  [signalProcessingThread] closing listening socket: 5
2016-03-23T10:09:36.807+0000 I NETWORK  [signalProcessingThread] closing listening socket: 6
2016-03-23T10:09:36.807+0000 I NETWORK  [signalProcessingThread] removing socket file: /tmp/mongodb-27017.sock
2016-03-23T10:09:36.807+0000 I NETWORK  [signalProcessingThread] shutdown: going to flush diaglog...
2016-03-23T10:09:36.807+0000 I NETWORK  [signalProcessingThread] shutdown: going to close sockets...
2016-03-23T10:09:36.808+0000 I STORAGE  [signalProcessingThread] WiredTigerKVEngine shutting down
2016-03-23T10:09:36.852+0000 I STORAGE  [signalProcessingThread] shutdown: removing fs lock...
2016-03-23T10:09:36.852+0000 I CONTROL  [signalProcessingThread] dbexit:  rc:
``` 0

All of those logs are mongo logs, not meteor logs.  I would decompose the containers (run them individually), if you can't find the meteor logs.

i think I don't do it the right way. my app have a meteor mongo dbs. did i need to use docker-compose ?

There is no problem with using Docker Compose.  I am saying that, for diagnostic purposes, you do NOT use Docker Compose, since you are having trouble obtaining the debug logs from the Meteor container.  Just run the mongo and meteor containers separately and manually link them.  Something like
docker run -d --name mongo -p 27017:27017 mongo
docker run --name meteor --link mongo:mongo -v ./:/app ulexus/meteor

hi !
when i start it one by one :
meteor_1 | Failed to locate main.js in /var/www; cannot start application. ```
When i start like ```repo=https://github/myrepo``` it's work fine :( si it's not an mongo error

This is as expected.  If you are trying to link into place your Meteor source directory, you need to bind mount it into the appropriate location.  By default, that is /src/app/, but you may override that by setting SRC_DIR.  Presuming your application source is in ., as I am inferring from your volume description, you will want to run meteor with something like:
docker run --name meteor --link mongo:mongo -v ./:/src/app ulexus/meteor

Closing this old issue; please re-open if you are still having trouble.


Test project parity with botbuilder-dotnet

Describe the solution you'd like
It should be easy for JS SDK contributors to test Adaptive Runtime and Skills-related changes without having to:

use npm pack
use symlinks
create a test project and manually git ignore it or create another branch separate from their workstream for testing.

Additionally, we likely don't need every test project in microsoft/botbuilder-dotnet. The test projects should be deliberately chosen and then learnings should be applied back to botbuilder-dotnet to clean up that repo/solution.

This has been reviewed by the SDK team. Closing as not needed.


Update version in package-lock on release

changeset version updates package.json, but not package-lock.json.
Changeset has an open issue for this, https://github.com/changesets/action/issues/203.
A suggested workaround is to use npm install, https://github.com/changesets/action/issues/203#issuecomment-1460115073

Interesting
https://github.com/changesets/changesets/issues/1139


Adding companion instance method with scope

Fixes #
This pull introduces/changes:

For Every scope defined on model, there will be a instance method with same name.
Most ofter when I define a scope like scope :active_friends, -> { friends.where(status: 'active') } and I have to get active friends of a particular user I have to do something like user.as(:u).active_friends. With the change in this PR, I will have by default a user.active_friends method.

Codecov Report

Merging #1512 into master will increase coverage by <.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #1512      +/-   ##
==========================================
+ Coverage   96.82%   96.82%   +<.01%
==========================================
  Files         205      205
  Lines       12682    12688       +6
==========================================
+ Hits        12279    12285       +6
  Misses        403      403

Impacted Files
Coverage Δ

spec/e2e/scope_spec.rb
100% <100%> (ø)
:arrow_up:

lib/neo4j/active_node/scope.rb
94.11% <100%> (+0.17%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 10066fe...5cd4dc6. Read the comment docs.

This will also address #1461

Ahh I missed that PR @thefliik, Let me know if you want incorporate this change in your PR, I can close this.

No, the conclusion reached in #1461 was that this is a better solution to the problem.

Released as 9.3.0


Global monitoring support

Update rancher-monitoring chart
Add rancher-thanos chart

Updated

Please squash the commits

https://github.com/cnrancher/pandaria/wiki/Pandaria-system-charts维护准则

Rebase the PR as we synced with upstream
Create a new monitoring chart with version 0.0.7000 per https://github.com/cnrancher/pandaria/wiki/Pandaria-system-charts维护准则
Squash the commits and use PANDARIA: as the prefix in commit message

And maybe we need to submit the PR to release-v2.3-ent branch

Updated

Changed the base branch to dev. Please rebase again

base copy should be from 0.0.7. And please make sure we have this fix https://github.com/rancher/system-charts/pull/165 in our 0.0.7000 version.


VM AOT crash in collection tests with NNBD changes

This CL makes some changes to the core libraries to eliminate casts in the NNBD splay tree code.  The AOT compiled code for corelib/collection_length_test seems to be crashing on the nnbd try bot.  See log here

https://dart-review.googlesource.com/c/sdk/+/143310 should fix the tests failing on vm-kernel-precomp-nnbd-linux-release-x64-try bot.


feat: add tip stdcheat

Gm! This is a new tip stdcheat.
Motivation
Simplify funding an account with a set amount of an arbitrary ERC20 token.
Solution
A convenient solution you can use in tests:
tip(alice, 10000e18, dai);

// Let's test it
assertEq(daiToken.balanceOf(alice), 10000e18); // [PASS]

Especially useful when forking.
Edit: Need to make a few changes to make it work with every a majority of tokens. ✔ DONE

Update

EIP-20: Token Standard requires only that the token has the balanceOf method, not how to store balances or report them.
We can only assume that the token will report a balance honestly. Also, different tokens store balances in different ways. For example, DAI stores them in balanceOf, 1INCH in _balances, MATIC in balances.

Solution

A majority of tokens read a balance  immediately when the balanceOf method is called, but we must not assume this to always be the case.
I have changed how the tip stdcheat works, so it can always set a balance to what we want, when the balance is read immediately after calling balanceOf. If balanceOf reads some other values before reading a balance, you must specify the name of the mapping that holds balances:

// WHEN READ IMMEDIATELY:

/// function balanceOf(address account) public view override returns (uint256) {
///     return _balances[account];
/// }

tip(address(1inch), 10000e18, alice);

// WHEN NOT READ IMMEDIATELY:

/// function balanceOf(address account) public view override returns (uint256) {
///     bytes32 something = someStateVariable;
///     ...
///     return _balances[account];
/// }

tip(address(atypicalToken), "_balances", 10000e18, alice);

Ready for review!

is this ready for review now?

is this ready for review now?

Yes, it is.

Hey
Thought I'd just comment here instead of creating a new issue. Isn't the term "tip" a bit misleading since the cheat code is setting the balance and not adding to it? Maybe an overloaded deal would be better. Also, might make sense to update totalSupply along with the balance

@shuklaayush
I had considered making tip add to a balance, but setting a balance is more useful. Do you have a better name for it? I don't want hevm cheatcodes and stdcheats to be confused, which is why it is not called deal.
Since this stdcheat takes the address of an arbitrary ERC20 token, we aren't aware how the token operates. For example, it's totalSupply might be essential for some internal logic and changing it could break something, which is why I went with a minimal approach.

Ah, cool. Didn't realize that you intentionally avoided naming it deal. Only alternative I can come up with off the top of my head is allot but I guess tip is fine too
While I agree that it's better to keep the logic minimal, I think practically it's more likely that someone will run into an error when totalSupply isn't equal to the sum of balances as compared to an error where the token contract implements some special logic around totalSupply
Anyways, I don't have strong opinions on either. Thought I'd share my two cents since I did some similar stuff when testing out contracts with foundry


storing birthday in DB even after a user leaves and rejoins the server

maybe an issue for the backend(?) but groups are stored in the DB even after a user leaves but birthdays are reset back to unknown.

Yeah, this is indeed faulty but duplicate of #37

right 🤔 i knew i saw it somewhere before, mb


add c release workflow

Description
This workflow is needed to create c release on demand so we can add a PR to conan-center-index.
Type of change
Please delete options that are not relevant.

[x] New feature (non-breaking change which adds functionality)

What about publishing to Conan?

What about publishing to Conan?

As mentioned in the description, we will need this workflow so we can create a PR in that index repository with the artifact


Fix not logging correct throwable

2.6 release is re-logging previously logged throwables instead of logging the one that was passed in

Merged into master in commit a523dcd. Please verify and close.

This PR has been merged into master. Is there any way for me to close it or mark it as merged?

Yes, thank you, closing


Syntax highlighting for inline HTML

As it is to be seen in the screenshot, inlined HTML syntax in Angular components template blocks is not highlighted.
Is there some snippet/package or any existing way to fix this?

Angular syntax is not supported by Atom out of the box – you would need to install some community package to add full Angular syntax highlighting support.
In the future, you'll have better luck asking support questions like this on Discuss or Slack – GitHub Issues is really just meant for bugs or feature requests. See the Contributing guide for more info.
:beers:


Add a few shards

I have a few Lucky shards if you want to add them
https://github.com/jwoertink/lucky-basic-auth
https://github.com/jwoertink/lucky-cluster/

Merged to master - thanks for sharing @jwoertink!
Keep 'em coming! Your cluster shard is particularly interesting - definitely going to play with it some when I have some free time. Excited to see what you come out with next!


[MWPW-154906] Pricing Cards Credits For AI Pages

Describe your specific features or fixes
Implements a new pricing cards block for AI pages. This card is a stripped down version of our pricing-cards that shows the number of free AI tokens a user can expect

Resolves:  https://jira.corp.adobe.com/browse/MWPW-154906
Test URLs:

Before: https://main--express--adobecom.hlx.page/express/
After: https://ai-page-pricing--express--adobecom.hlx.page/drafts/echen/pricing-cards-credits

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 40.43%. Comparing base (a5d054d) to head (002762f).
Report is 15 commits behind head on stage.

Additional details and impacted files
@@            Coverage Diff             @@
##            stage    #1047      +/-   ##
==========================================
+ Coverage   38.69%   40.43%   +1.74%
==========================================
  Files         116       97      -19
  Lines       25143    22676    -2467
==========================================
- Hits         9729     9169     -560
+ Misses      15414    13507    -1907

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Error: Invalid for_each argument

Describe the Bug
╷
│ Error: Invalid for_each argument
│
│   on  ecr/modules/ecr/main.tf line 310, in resource "aws_ecr_repository_policy" "name":
│  310:   for_each   = toset(local.ecr_need_policy && module.this.enabled ? local.image_names : [])
│     ├────────────────
│     │ local.ecr_need_policy is a bool, known only after apply
│     │ local.image_names is list of string with 2 elements
│     │ module.this.enabled is true
│
│ The "for_each" set includes values derived from resource attributes that cannot be determined until apply, and so Terraform cannot determine the full set of keys that will identify the instances of this resource.
│
│ When working with unknown values in for_each, it's better to use a map value where the keys are defined statically in your configuration and where only the values contain apply-time results.
│
│ Alternatively, you could use the -target planning option to first apply only the resources that the for_each value depends on, and then apply a second time to fully converge.
╵

Expected Behavior
no issues
Steps to Reproduce
fresh deployment using ecr, using
module "ecr" {
  source  = "cloudposse/ecr/aws"
  version = "0.40.0"
}

Screenshots
No response
Environment
No response
Additional Context
No response

in 0.36 as well
│   on ecr/modules/ecr/main.tf line 233, in resource "aws_ecr_repository_policy" "name":
│  233:   for_each   = toset(local.ecr_need_policy && module.this.enabled ? local.image_names : [])


Fix deserializing Document

When calling Bot::send_document, I get an error: InvalidJson(Error("data did not match any variant of untagged enum TelegramResponse", line: 0, column: 0)).
Also, when compiling my app with freshly cloned teloxide-core, I got compilation error (see the 1st commit).
This PR fixes both problems.

@Mr-Andersen LGTM. Can you squash the fix commits though, so the git history is cleaner?

@WaffleLapkin I thought people like small commits...

@Mr-Andersen we do like small commits, but this branch currently has 2 commits that add cfg(test) and one commit that removes it =)

@WaffleLapkin I think I did that


camel-jbang: comma separated should also be supported with --dep option

Description

Target

[ ] I checked that the commit is targeting the correct branch (note that Camel 3 uses camel-3.x, whereas Camel 4 uses the main branch)

Tracking

[ ] If this is a large change, bug fix, or code improvement, I checked there is a JIRA issue filed for the change (usually before you start working on it).

Apache Camel coding standards and style

[ ] I checked that each commit in the pull request has a meaningful subject line and body.

[ ] I have run mvn clean install -DskipTests locally from root folder and I have committed all auto-generated changes.

Ah nice with the split


clearing sqlite_sequence is not working in android room

Following code is not resetting/clearing the auto increment id to 0
database = Room.databaseBuilder(getApplicationContext(), AppDatabase.class,DatabaseMeta.DB_NAME).build();
database.query("DELETE FROM sqlite_sequence WHERE name = ?", new Object[]{"tableName"});
Is there any other way to clear "sqlite_sequence"?
Android room is not using "sqlite_sequence" for auto increment i think, not sure.

I'm sure room is using "sqlite_sequence".. But I too face this problem

Im also faced with the same problem!  not sure how I can reset auto increment id to 0

As per the answers given here, and here, and here, I could do it as following:
public void deleteAndReset() {
        SQLiteDatabase database;
        database = SQLiteDatabase.openOrCreateDatabase(getDatabasePath(MY_DATABASE_NAME), null);
        String deleteTable = "DELETE FROM " + MY_TABLE_NAME;
        database.execSQL(deleteTable);
        String deleteSqliteSequence = "DELETE FROM sqlite_sequence WHERE name = '" + MY_TABLE_NAME + "'";
        database.execSQL(deleteSqliteSequence);
}


Add warn that user can not use --strictPropertyInitialization without --strictNullChecks

Fixes part of #23659

thanks @a-tarasyuk. we also need a test to go with this change. see tests\cases\compiler\optionsInlineSourceMapMapRoot.ts for an example.

@mhegazy Ok

thanks!


Meet with the BC Developers Exchange folks

When the blog was posted, BCDevExchange reached out with an offer to meet up in their virtual lab to talk with the Code with Us and Sprint with Us folks.
Aiming to set this meeting up for the week of Aug. 31.

First meeting on Sept 23. Details of meeting in the engagement tracker. https://014gc.sharepoint.com/:x:/r/sites/GCDevEx/Shared Documents/Engagement tracker - GCDevEx.xlsx?d=we2e970743126466caa47c58576b25d64&csf=1&web=1&e=fhMG5R


Adapt tutorial to refactored code

[ ] Adapt inputs
[ ] add data plotting example
[ ] rerun with lower bound for b


Remove -TimeOutSec from non timeout related Web Cmdlets Tests

PR Summary
Timeouts were originally used in many tests because they relied on unreliable external sites. WebListener may be a bit slow inside CI, but it is reliable in that it is always present. This PR removes the -TimeOutSec option from tests where -TimeOutSec is not required. the remaining instances either it or would be unaffected (such as testing immediate parameter validation errors).
PR Checklist
Note: Please mark anything not applicable to this PR NA.

[X] PR has a meaningful title

[X] Use the present tense and imperative mood when describing your changes

[X] Summarized changes
[NA] User facing Documentation needed

[NA] Issue filed - Issue link:

[X] Change is not breaking
[NA] Make sure you've added a new test if existing tests do not effectively test the code changed

[X] Add [feature] if the change is significant or affects feature tests

[X] This PR is ready to merge and is not Work in Progress.

If the PR is work in progress, please add the prefix WIP: to the beginning of the title and remove the prefix when the PR is ready.

I think both of you have good points. Ideally, the timeout mechanism should be supported by the test framework (Pester here).

The only suggestion I have is to query the history of these tests since the weblistener was introduced and determine if there are cases where the timeout was hit; otherwise, LGTM.

Created https://github.com/pester/Pester/issues/983 to have them support -Timeout

@dantraMSFT This PR, #6069 and #6013 is just the result of the fact that these tests have recently started to get timeouts.

I agree that it is better to have timeout support in Pester.


Add snapshot test for exposed types

Codecov Report

Merging #247 (ba360f1) into master (61d8e90) will not change coverage.
The diff coverage is 100.00%.

:exclamation: Current head ba360f1 differs from pull request most recent head 70116e9. Consider uploading reports for the commit 70116e9 to get more accurate results

@@            Coverage Diff            @@
##            master      #247   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           19        19
  Lines          215       219    +4
  Branches        29        29
=========================================
+ Hits           215       219    +4

Impacted Files
Coverage Δ

src/types.ts
100.00% <100.00%> (ø)

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more


Support Querying Workshop Content

I need support for querying workshop content, which is currently missing.
I could try working on this.

I could try working on this.

I don't have the workshop setup for my game currently (I plan to but much later than now). If you could work on this it would be great!

This exists now (forgot to close this issue awhile ago)


when storymap data is uploaded to CSV, do not call googleDocURL

@ilyankou whenever you have time to look at this non-urgent issue, I think you designed the code to address this, but I cannot figure out how to make it work properly
Goal: To "archive" this storymap, I have migrated Chapters and Options data from GoogleSheet to CSV folder in GitHub.
Now I want the code to (a) ignore the existence of the GoogleSheet and (b) NOT point to the googleDocURL in the "data by" attribution, as shown here:

Years ago, I think you designed the code to address this issue when you wrote this section:
https://github.com/OnTheLine/otl-urban-renewal-new-london/blob/539e92781cff30ee73ad2755ee6a390a036e60ca/scripts/storymap.js#L483
If so, then I cannot figure out how to set the googleDocURL to empty (or whatever), in order for it to link to Chapters.csv
So far I have tried two methods in the google-doc-url.js file, but neither seems to work for me:
var googleDocURL = '';
and
var googleDocURL = null;
More about Goal part (a):
Overall, I've noticed that the code behaves differently on GitHub Pages online versus my local Firefox test setup, as shown in the side-by-side screenshots below. Even when the data is uploaded as CSV, the Firefox setup continues to display the Google Sheets data. Not a deal breaker, but wonder if this might be a related issue, so decided to mention it.

Hi @JackDougherty
I think the issue is with the browser not being able to access the CSV file when you open index.html locally by double-clicking. You will need to run a local server, for example either via Python:
cd otl-urban-renewal-new-london # navigate to the project folder here
python -m http.server

(and then type localhost:8000 in Firefox)
or use a tool like live-server. This will ensure what you see locally is the same as GitHub.

@ilyankou - Many thanks for the http.server tutorial, which solved part (a) of my issue, and allowed me to test a successful result for part (b), which I'll add to our HandsOnDataViz book, unless you tell me otherwise:
After migrating storymap data from your Google Sheet by uploading Chapter.csv and Options.csv files to the GitHub CSV folder, go to the google-doc-url.js file and replace the variable for the Google Sheet URL to null:
var googleDocURL = null;


train_size=1 is ambiguous

Our docstring clearly states that if you give train_size an int, it will take that many cells in the training set, but 1 is an ambiguous case as 1.0 means train on the whole dataset and 1 means train on one cell. A caveat here is that scVI skips minibatches of < 3 cells.
We should restrict this option to only allow float between 0.0 and 1.0. Also, we need a warning statement of the training size is really low.

Agree with this option

I just encountered another paper that does the same mistake. @galenxing could you help us put a fix on this ASAP?


Fixes custom data type mismatch in python algorithms

Description
If the custom data type is a C# type, it should be used instead of wrapping it around a PythonActivator object.
Related Issue
Closes #2293
Motivation and Context
Fixes custom data support for python algorithms.
Requires Documentation Change
No.
How Has This Been Tested?
Algorithm provided at #2293 and Tiingo algorithm (yet to be merged).
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Non-functional change (xml comments/documentation/etc)

Checklist:

[x] My code follows the code style of this project.
[x] I have read the CONTRIBUTING document.
[x] All new and existing tests passed.
[x] My branch follows the naming convention bug-<issue#>-<description or feature-<issue#>-<description>

@AlexCatarino Thanks for the quick fix ;)
I would recommend adding this line to BasicTemplateIntrinioEconomicData.py, so we have the C# custom data type case covered in a regression algorithm:
self.ema = self.EMA("$DCOILWTICO", 5)


Updating Readme from Example branch

Updates
I update the README File. Please review and accept.

Thoughts
i probably shouldn't, But it's okay. 👍


Fresh install on EKS causes coredns failures (Istio + NodeLocalDNS)

Support
I have an EKS cluster using the official eks-cni plugin and Istio (in case that's relevant) and NodeLocalDNS. In order to keep cluster bootstrapping simple (no manual deletion) I wanted to go with the chaining method and followed the instructions on this page exactly.
My helm values look like:
        global:
          cni:
            chainingMode: aws-cni
          masquerade: false
          tunnel: disabled
          nodeinit:
            enabled: true

After installing this, I noticed my pods couldn't make requests anymore. One thing I did notice is that coredns was in a crash loop. I had to quickly roll back so I didn't get to investigate too deep but I do have most logs available from the pods, and I do see that Cilium tried to restart coredns -- it just never came back up healthy. It might have been failing health checks.
I mention istio because i do have mTLS enabled and it does rewrite liveness probes, but it is not enabled in the kube-system namespace where coredns and cilium exists so I highly doubt it matters.
I'm hoping to make another attempt soon to gather more information if there's anything specific I can check for.
Environment information:
AWS EKS v1.16.8
Cilium v1.8 Helm Chart
Istio 1.5
NodeLocalDNS

this one seems to be related: https://github.com/cilium/cilium/issues/12571

I tried this again without hitting this particular issue. My only guess is that the EKS AMI is on a 4.x kernel and part of our userdata script updates everything and I can see k8s change the kernel to 5.x. Perhaps the first time, I had a node that was still on 4.x and incompatible.
I'll close this one but if you see a similar issue consider looking at #12571 above.
The next issue in my journey is https://github.com/cilium/cilium/issues/12647.


is this the correct response from getLicenseInfo() ? Android 6.0.1 + Crosswalk

getLicenseInfo() is returning null / undefined to the callback params '(txt,txt2)' similar to the documented example for Android (6.0.1) on a Nexus 5.
Worth mentioning that I get correct license info when running on iOS.
Since that is no longer an issue, and I'm actually receiving test instead of null/defined. The returned text (6624 lines!) made me wonder of that's what I should be expecting:
Gist of License info text
It lagged my android device when opened, especially when opened in a AlertDialog over the full screen map.

Well , scratch that; it decided to work without me changing anything 🤔🤔🤔

That is the text you should expect. Your best bet will be to stick it somewhere other than a dialog - that control was never designed to handle this much text. Try overlaying a div with it, or something cleaner depending on your choice of UI toolkit.

It seems this is a bug of Google Play Services.
http://stackoverflow.com/questions/37273810/getopensourcesoftwarelicenseinfo-is-returning-null-now


Implement prompt/generation alignment

Opening this PR to discuss the implementation of token alignment (#161)
This is not intended to be merged, I was just wondering whether you think this is a promising direction to look into
The idea is to modify the self.states_to_token_maps of the fsm associated to each prompt to create a new state to accommodate the fact that a token has been removed compared to when this map was created during the initialization of the fsm
Disadvantage:

The case in which the text after the "boundary" of a token matching the end of the prompt does not exist in the vocabulary by itself is not covered

Advantage:

It takes very little time to update the fsm in that way

This is not intended to be merged, I was just wondering whether you think this is a promising direction to look into

I think this is the right general direction.

The case in which the text after the "boundary" of a token matching the end of the prompt does not exist in the vocabulary by itself is not covered

Could you illustrate this?

Could you illustrate this? I had a PR opened (can't find it right now) where I iterated once over the vocabulary to find the overlapping tokens.

Making up a fake example. My prompt is "Good mor". Let's say there's a token for "mor" and it's the last one of the prompt. We would want token alignment to replace "mor" with "morning". However, if the token "ning" by itself does not exist, then there's nothing in the states_to_token_maps that correspond to it as, at this point, the character-based FSM that would allow to generate "ning" has already been turned into a token-based mapping.
I was looking at creating states_to_token_maps only after the call is made (and the FSM is updated) but that would add too much overhead.
I was then thinking that a solution could be to create at initialization a mapping that contains both information about characters and about tokens (so we would have some states with no tokens leading to them that would be used for the token alignement)

How about looping over the entire vocabulary and store the tokens that accept mor as a prefix. Then, in the unconstrained case the first state of the FSM would have transitions to the overlapping tokens only?
Haven't taken the time to think about the constrained case yet.

What I thought was the issue with this approach concerns at what state we end up in the FSM after the part "the first state of the FSM would have transitions to the overlapping tokens only". I had initially imagined that we take the postfix, find the associated token and the state to which it would transition from the original initial state of the FSM. But then the transitions in the original FSM from the initial state can only include postfixes that exist as standalone tokens in the vocabulary.
I have a pretty hard time explaining what I have in mind (I may just be confused actually), sorry. I'm going to try to find a real example

Here's the issue I was blocked by @rlouf:
# our prompt's last token is "ra"
# we want to be able to replace with the token "rans" that is part of the vocabulary

import outlines
import interegular
from outlines.fsm.regex import create_fsm_index_tokenizer, make_deterministic_fsm

regex_string = r'[n-s]{2}[0-1]'

model = outlines.models.transformers("hf-internal-testing/tiny-random-gpt2")

regex_pattern = interegular.parse_pattern(regex_string)
regex_fsm, _ = make_deterministic_fsm(regex_pattern.to_fsm().reduce())
print(regex_fsm)

#  name final? 0 1 n o p q r s anything_else
#--------------------------------------------
#* 0    False      1 1 1 1 1 1
#  1    False      2 2 2 2 2 2
#  2    False  3 3
#  3    True

states_to_token_maps, empty_token_ids = create_fsm_index_tokenizer(
    regex_fsm, model.tokenizer
)
characters_map = {}
for key, value in states_to_token_maps.items():
    characters_map[key] = {}
    for a, b in value.items():
        characters_map[key][model.tokenizer.decode([a])[0]] = b
print(characters_map)

#{
#    0: {'so': 2, 'o': 1, 'p': 1, 'q': 1, 'pp': 2, 'op': 2, 'pr': 2, 'ro': 2, 'r': 1, 'or': 2, 'os': 2, 's': 1, 'n': 1, 'on': 2},
#    1: {'r': 2, 's': 2, 'n': 2, 'o': 2, 'p': 2, 'q': 2},
#    2: {'0': 3, '1': 3}
#}

# problem: there's no token at state 0 whose characters are equal to "ns"
# if we were to replace the "ra" at the end of the prompt by "rans", we would not know
# where we are in the fsm

Now that I'm writing it down like that, I realize that maybe we're always sure that there are tokens for each individual characters that compose the postfix in our states_to_token_maps (like here) such we could always walk the states_to_token_maps character by character until we end up at the end of the postfix (so we would know what state we end up at)

I had not realized that I could walk the states_to_token_maps character by character for the postfix part of the crossing tokens in the constrained case. I think it works with almost no additional overhead like that. Let me know if you think it's fine and I'll update the tests afterward

Yes I think that's the right approach. There's some stuff to figure out in terms of design, but otherwise looks good.

I'll write unit tests next if you think having those separate functions is the right design

I have small design comments, but nothing that would dramatically affect your solution. You can start implementing tests.

We're getting really close. There are a few design changes remaining, and mostly we should have comprehensive tests before merging.

I rebased your branch on main after a big refactor of the FSM interface. I will take a closer look this week.

Is this still something we want to work on?

Yes! I'm currently thinking about how we could integrate that to the logits processors since most integration are going to use this :)

Sorry to prod but please don't lose sight of this! I think this is a very important change to make Outlines the most competitive structured generation system

I think it is time to revisit this as #966 is about to be merged and the custom sampling loop will be removed. We can still implement this via passing logit processors to downstream libraries. Incidentally that also means that we will be adding this feature to every upstream library :)
@RobinPicard are you still interested in implementing this?

@RobinPicard are you still interested in implementing this?

I can look at adapting it to the change made this week end

@RobinPicard are you still interested in implementing this?

I can look at adapting it to the change made this week end

That's great news!
Please let me know if you run into any issues or have any questions about OutlinesLogitsProcessor.
You probably want to branch from https://github.com/outlines-dev/outlines/pull/966 since it has fixes to the logits processors and a more detailed docstring.

To make sure I understand the wider context, the plan is to eventually remove SequenceGenerator and only use SequenceGeneratorAdapter @lapp0, right?

Indeed

I rebased on your branch and modified my initial commit @lapp0

Could you rebase on main now that #966 was merged?

This issue is causing problems for the PR. If we don't have an explanation/solution for it, we would have to modify the logic related to FSMLogitsProcessor._fsm_states. I don't know yet what we could replace it with if the order of sequences is not maintained + the values of previous tokens can change though.

@RobinPicard per my comment in the linked issue, it appears that transformers beam search submits an unused sequence group to logits processors during the final generation step. Is this still an issue if it only occurs on the last step and it's not actually part of generation?
Please let me know how I can help.

It's fine if it only happens at the final generation step, I simply added a try:... except KeyError:... block

Glad that it's not blocking, please let me know if you run into any other issues or have any questions!

I don't have more questions, I would be interested by a review of the PR though!

I don't get how step 2 would work. Are the unhealed tokens passed down to the original Guide just the user prompt?
Another design I'm considering for better separation of token healing and Guides is to create a dedicated class and have Guides that implement token healing inherit from it on top of GuideProtocol. Do you think that would be better?

I don't get how step 2 would work. Are the unhealed tokens passed down to the original Guide just the user prompt?

Another design I'm considering for better separation of token healing and Guides is to create a dedicated class and have Guides that implement token healing inherit from it on top of GuideProtocol. Do you think that would be better?

Here's roughly what I'm thinking
In SequenceGeneratorAdapter

set the prompt as alignment_guide.prompt_prefix
then call model.generate,
then left-truncate generations

In AlignmentGuide

Constructor: AlignmentGuide(prompt, tokenizer, child_guide=None)

Let self.start_generation_tokens be the set of legal starting tokens for child_guide (or all tokens if no guide)
Tokenize (prompt, token) for token in start_generation_tokens and determine the "longest common self.prompt_prefix" and the set of legal self.prompt_suffix_ids
self.initial_state = AlignmentGuideState(legal_paths=legal_start_generation_tokens, child_guide_state=child_guide.initial_state)

For get_next_instruction(state)

If legal_paths None, alignment is complete. Defer to the child_guide.
If legal_paths is not None, tokens = [path[0] for path in state.legal_paths]

For get_next_state(state, token_id)

If legal paths: filter state.legal_paths such that it only includes those starting with token_id

If generating the final token in a path, pass the unaligned token to the child_guide, return `AlignmentGuideState(legal_paths=none, child_guide_state=new_child_guide_state)

If no legal_paths is None: Use the child guide to update child_guide_state

This design requires constructing a Guide for each prompt, however this is necessary because the behavior of the Guide varies prompt-to-prompt.
Details surrounding how to pre-process and manage state for AlignmentGuide may vary, this is just a rough outline.
Please let me know if this makes sense, or if I'm missing something.

I think I understand the general idea. The main issue I have concerns

If generating the final token in a path, pass the unaligned token to the child_guide

I don't get what the unaligned token means in this context.

I don't get what the unaligned token means in this context.

Sorry I wasn't clear here.
For example, if the prompt is "hello wo" and we truncate it to "hello" for alignment, and the model generates the token " world" as the next output, "rld" is what needs to be passed to the child guide to continue processing.
This allows for alignment to be compatible with any guide with minimal changes.

Ah I see, but I thought the problem is that "rld" may not exist as a token in the vocabulary so it would not be found in the states_to_tokens_map. Or should we walk through the states_to_tokens_map of the child guide character by character in the get_next_state method of AlignmentGuide when the generation reached the crossing token?

Sorry for the delayed response.

but I thought the problem is that "rld" may not exist as a token in the vocabulary so it would not be found in the states_to_tokens_map.

If I'm understanding the problem correctly, to mitigate this we need to determine the "longest common prompt prefix". This will allow any legal token to be generated as a "pseudo-token".

Or should we walk through the states_to_tokens_map of the child guide character by character in the get_next_state method of AlignmentGuide when the generation reached the crossing token?

Can we precompute this when the guide is constructed?


Wrong colors

I've just got myself one CYD and getting started. I went through the set up for lcgl (lv_conf.h) and TFT_eSPI (User_Setup.h). I can build the LVGL example and in principle, everything works but the colors are all "negative", looking like this:

When I use tft.invertDisplay() it looks better but the colors are "washed out" , the red here is very pale and the green looks like a grey:

This is how the demo looked when I received the display:

Anybody knows how to fix this? LV_COLOR_16_SWAP 1 in lv_conf.h doesn't help and screws the colors up completely.

This is a known issue with the version with two USB ports.
You've already sorted the first issue of the inverted colours, there is some discussion about fixing the colours here:
https://github.com/Bodmer/TFT_eSPI/issues/2985

Cool, that fixed it for me, thanks!


Adding a system requirements page

There a lot of questions in the Alpaca LoRa discord about the system requirements. It would be nice to have a page with all the current info compiled. There is a chance that the info might go stale, but it might better than not having it.

Addition of Alpaca or Alpaca LoRa weights does not significantly impact the requirements.

Is this true? LoRA should reduce the memory requirements for fine-tuning.


No Support for Protocol, Port and Base Path configuration for anypoint_apim_flexgateway resource

We are using Terraform Anypoint Provider version 1.6.1 downloaded from Terraform Registry.
When we tried to create flexgateway resource using anypoint_apim_flexgateway, we found API is getting created with default protocol as HTTP, Port as 8081 and Base Path as '/'. We did not see any configuration option to override these values.
Can you please let us know when these enhancements will be available ?

@soufi  - any comments on this please? Thanks

Hi @vaibhav-yenorkar
Flex Gateway will use any port you tell it to when you create your configuration. The port should be added to the consumer url.

Thanks @soufi for suggesting to use consumer url.
I am able to set port, protocol and basepath using endpoint_proxy_uri property.

@sabsfdc can you please close this one ?


[DUBBO-3746] Bugfix: infinite loop in AbstractRegistry when IOException. fix #3746

What is the purpose of the change
resolve #3746
When IOException is thrown in org.apache.dubbo.registry.support.AbstractRegistry#doSaveProperties, which is usually unrecoverable (permission denied, path not exists or no free disk space) it will retry infinitely, this patch tries to resolve this issue by stop retrying when IOException occurs.
Brief changelog
org.apache.dubbo.registry.support.AbstractRegistry
Verifying this change
XXXXX
Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a GITHUB_issue field for the change (usually before you start working on it). Trivial changes like typos do not require a GITHUB issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[x] Format the pull request title like [Dubbo-XXX] Fix UnknownException when host config not exist #XXX. Each commit in the pull request should have a meaningful subject line and body.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Write necessary unit-test to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
[x] Run mvn clean install -DskipTests=false & mvn clean test-compile failsafe:integration-test to make sure unit-test and integration-test pass.
[x] If this contribution is large, please follow the Software Donation Guide.

Codecov Report

Merging #3748 into master will increase coverage by 0.03%.
The diff coverage is 0%.

@@             Coverage Diff              @@
##             master    #3748      +/-   ##
============================================
+ Coverage     63.55%   63.59%   +0.03%
  Complexity       71       71
============================================
  Files           704      704
  Lines         31069    31072       +3
  Branches       5037     5038       +1
============================================
+ Hits          19746    19760      +14
+ Misses         9050     9037      -13
- Partials       2273     2275       +2

Impacted Files
Coverage Δ
Complexity Δ

...pache/dubbo/registry/support/AbstractRegistry.java
79.76% <0%> (-0.95%)
0 <0> (ø)

...bo/rpc/cluster/support/FailbackClusterInvoker.java
67.21% <0%> (-3.28%)
0% <0%> (ø)

.../exchange/support/header/HeaderExchangeServer.java
68.86% <0%> (+0.94%)
0% <0%> (ø)
:arrow_down:

...he/dubbo/registry/multicast/MulticastRegistry.java
69.68% <0%> (+1.8%)
0% <0%> (ø)
:arrow_down:

...dubbo/remoting/exchange/support/DefaultFuture.java
75.51% <0%> (+2.04%)
0% <0%> (ø)
:arrow_down:

...che/dubbo/remoting/transport/mina/MinaChannel.java
53.94% <0%> (+10.52%)
0% <0%> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c11df93...afe19c0. Read the comment docs.

What if other type of exception other than IOException is thrown, this might introduce the same issue. I think a safer way is to limit the number of time to retry.

What if other type of exception other than IOException is thrown, this might introduce the same issue. I think a safer way is to limit the number of time to retry.

@ralf0131 how many times to retry? I think 3 is enough, what's your opinion?

What if other type of exception other than IOException is thrown, this might introduce the same issue. I think a safer way is to limit the number of time to retry.

@ralf0131 how many times to retry? I think 3 is enough, what's your opinion?

3 looks good to me.

Ping @carryxyh , what's your opinion on this pull request?

Sorry for coming late. @kezhenxu94 @ralf0131
I have no more comments on this pr. After my test, multiple threads read and write to the same file will not generate exceptions and will not be out of order. But we still have to consider some other special circumstances that cause the write to fail.
I think we can merge this pr first, I will conduct further testing and submit an extra pr if I think we need to optimize it.

@kezhenxu94
Pls help to check if org.apache.dubbo.metadata.support.AbstractMetadataReport#doSaveProperties has the same problem.


riscv-executor: handle machines that have been optimized away

Yeah, the original problem you mentioned is solved by this PR (machines being optimized away).
What fails is a different issue with the same origin: asm optimizer removes instructions, which messes with selector assignment, which breaks manual witgen. To solve this the executor needs to take into account the optimized PIL...

I'm closing this for now


[feature] Password protection

Would be nice to have a password/auth system enabled, better for people self hosting on a public web server

Why reinventing the wheel? There are several solutions available to protect a docker container, e.g. Authelia (https://github.com/authelia/authelia).
When you implement your own system I would bet that not long after you release it, the first users will ask on how to deactivate it and how to use with other services. ;-) So it could be easier to just plugin something existing and keep your code clean.

@svzi thanks for the information, I looked into it, and I feel that depending on an external service for authentication is not the way forwards, in my case, just a password would be sufficient, which would be ofcourse disabled by default.

@dgtlmoon Sorry my first answer didn't point you in the right direction, my fault. I wanted to show Authelia and recommend setting up just an additional docker container for authentication. That way you would not have any external dependencies in your project but could show interested users on how to protect your service.
But as you pointed out a password would be sufficient and for some people easier to use, because it will speed up the deployment of your service of course.
Keep up the good work! 👍


Add Phoenix properties to enable Phoenix namespace mapping

The attributes were set with Phoenix defaults.

This change when deployed to cluster, requires handholding with Phoenix users/tenants. This will impact Phoenix users.

Need to test with HDP 2.6.3 @bijugs

@ronny-macmaster. @RiteshVajariya  Certainly we can test once chef-bach is moved to HDP 2.6.3.

To Enable Namespace mapping, property values should be corrected.
cookbooks/bcpc-hadoop/attributes/hbase.rb
+  site_xml['phoenix.schema.isNamespaceMappingEnabled'] = true
+  site_xml['phoenix.schema.mapSystemTablesToNamespace'] = true

with HDP 2.6.3, we have acls for phoenix in place.
PHOENIX-4198 Remove need for users to have write permission to SYSTEM.CATALOG table.
To Implement security,
cookbooks/bcpc-hadoop/attributes/hbase.rb
+  site_xml['phoenix.schema.isNamespaceMappingEnabled'] = true
+  site_xml['phoenix.schema.mapSystemTablesToNamespace'] = true
+  site_xml['phoenix.acls.enabled'] = true
+  site_xml['hbase.coprocessor.master.classes'] = org.apache.hadoop.hbase.security.access.AccessController
+  site_xml['hbase.coprocessor.region.classes'] = org.apache.hadoop.hbase.security.access.AccessController,org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint

Apply Hbase Acl permissions:
#To Show all permissions on @SYSTEM NAMESPACE
user_permission '@SYSTEM'

#Grant Read only permission on @SYSTEM Namespace.
grant 'user', 'R' , 'SYSTEM:CATALOG'

#Grant respective 'RWXCA' [READ('R'), WRITE('W'), EXEC('X'), CREATE('C'), ADMIN('A')] permissions on user namespace
grant 'user', 'RWXCA' , '@userNamespace'

Thanks @saumilmayani . Refer issue #1110 for enabling Phoenix security feature. Also the original intention of the PR was to add these properties and not to enable namespace mapping.

Tested the PR as it is on a VM cluster with HDP 2.6.1 and it had no impact. Will wait to get 2.6.3 in to test on it.

@bijugs To confirm you will be enabling both of these as well as defining them, correct?

@bijugs can you list the things we should be monitoring on hbase and phoenix when we roll it out?

Once phoenix.schema.isNamespaceMappingEnabled is set to true on server and client, the first access of the client to the server will move the system tables to system namespace. That will be the main change. Will update with more details once tested on 2.6.3 .

2.6.3 merged to master #1107

Testing done with phoenix.schema.isNamespaceMappingEnabled set to true

Using hbase shell checked the namespaces
Connected to ```Phoenixusingsqlline.pyfrom the worker node which is the first client connection which triggers the creation ofSYSTEM`` namespace and moves the SYSTEM tables under it.
Checked again the namespaces through hbase shell and verified that the SYSTEM namespace is created and the tables are moved
Created a new schema in Phoenix and a table under the schema through sqlline.py which also created a new namespace in HBase
Did do a select from the new table after issuing use schemaname command in sqlline.py

Sorry, @bijugs. I just created a merge conflict by merging #1119. I'll try to test this in a hardware cluster tomorrow morning regardless.

Merge conflict resolved. Change was deployed to a dev hardware cluster for further testing. Will merge once testing is completed.

Testing completed successfully on hardware.


Lost connection to PBI report

Describe the problem
When opening Bravo within PowerBI it seems to somehow lose contact with my Power BI report in Power BI desktop after a few seconds. It's there for a moment though. On the NOT AVAILABLE button in Bravo the message says "The report was closed i Power BI desktop. Any writing operation is disallowed". But the report is not closed in PBI desktop. Nor can i connect to a pbix file on my computer, but works to connect to resport i PBI service.
What can this be about?  I'm running the latest version of PBI desktop, Pro user license. Swedish. I've tried restart and reinstallion of both Bravo and PBI desktop.
Bravo version
0.9.6 (0.9.8291.23631)
Tabular model
Power BI Desktop, import mode
Power BI
PBI desktop Version: 2.110.805.0 64-bit (october 2022)
Steps to reproduce the behavior
Open PBI desktop
Open pbix file with two dataset and one visualisation
No date table generated
No existing data table
Go to External tools
Open Bravo
Reads report
Lose connection to report after a few seconds
Additional context
No response
Screenshots

Anything else ?
No response

@Terpsixore thanks for reporting! This is a bug similar to the one already reported here https://github.com/sql-bi/Bravo/issues/476#issuecomment-1236915152
This issue is due to a different text format that Power BI Desktop applies to the report name/title depending on the display culture used on the PC. Bravo uses this title to get the report name and this small difference in format is the cause of the "NOT AVAILABLE" message.
Swedish:

English:

I have just pushed a fix for this issue, if you want to test you can try the internal build. To upgrade Bravo to this version (0.9.8338.15099) you can change the update channel from Stable to Dev in the options panel as shown in the following image.

Many many thanks, works great now!

Fixed in version 1.0.0


Adjust location check for systemd

Version
Microsoft Windows [Version 10.0.22000.1042]
WSL Version

[X] WSL 2
[ ] WSL 1

Kernel Version
<IP_ADDRESS>
Distro Version
SUSE-Linux-Enterprise-Server-15-SP4 & openSUSE Leap 15.4
Other Software
No response
Repro Steps
In /etc/wsl.conf:
[boot]
systemd=true
wsl --shutdown
wsl -d SUSE-Linux-Enterprise-Server-15-SP4
Expected Behavior
Normal loading, as it does for Tumbleweed (which symlinks /lib -> usr/lib). The issue seems to boil down to WSL checking for /lib/systemd (only) vs (an additional) /usr/lib/systemd (which is what Leap/SLE use).
A symlink of /usr/lib/systemd to /lib/systemd allows it to work (after a safeMode=true fix and subsequent wsl --shutdown followed by a relaunch of the distro).
Actual Behavior
PS C:\Users\User> wsl -d SUSE-Linux-Enterprise-Server-15-SP4
Catastrophic failure
Error code: Wsl/Service/0x8000ffff
PS C:\Users\User>
Diagnostic Logs
No response

@sbradnick - is /sbin/init also symlinked to /lib/systemd?

One does, the other doesn't have a symlink (by default):
Leap 15.4:
scott@WinDev2202Eval:~>  cat /etc/os-release
NAME="openSUSE Leap"
VERSION="15.4"
ID="opensuse-leap"
ID_LIKE="suse opensuse"
VERSION_ID="15.4"
PRETTY_NAME="openSUSE Leap 15.4"
ANSI_COLOR="0;32"
CPE_NAME="cpe:/o:opensuse:leap:15.4"
BUG_REPORT_URL="https://bugs.opensuse.org"
HOME_URL="https://www.opensuse.org/"
DOCUMENTATION_URL="https://en.opensuse.org/Portal:Leap"
LOGO="distributor-logo-Leap"

scott@WinDev2202Eval:~>  ls -l /sbin/init
ls: cannot access '/sbin/init': No such file or directory

SLES15SP4:
scott@WinDev2202Eval:~>  cat /etc/os-release
NAME="SLES"
VERSION="15-SP4"
VERSION_ID="15.4"
PRETTY_NAME="SUSE Linux Enterprise Server 15 SP4"
ID="sles"
ID_LIKE="suse"
ANSI_COLOR="0;32"
CPE_NAME="cpe:/o:suse:sles:15:sp4"
DOCUMENTATION_URL="https://documentation.suse.com/"

scott@WinDev2202Eval:~>  ls -l /sbin/init
lrwxrwxrwx 1 root root 26 May 11 20:30 /sbin/init -> ../usr/lib/systemd/systemd

There's also (interesting?) differences with /sbin and/or /sbin/init:
TW (/sbin -> usr/sbin):
scott@WinDev2202Eval:/mnt/c/Users/User>  ls -l /sbin/init /usr/sbin/init
lrwxrwxrwx 1 root root 22 Aug 31 22:29 /sbin/init -> ../lib/systemd/systemd
lrwxrwxrwx 1 root root 22 Aug 31 22:29 /usr/sbin/init -> ../lib/systemd/systemd

Leap (no /sbin symlink):
scott@WinDev2202Eval:~>  ls -l /sbin/init /usr/sbin/init
ls: cannot access '/sbin/init': No such file or directory
ls: cannot access '/usr/sbin/init': No such file or directory

SLES (no /sbin symlink):
scott@WinDev2202Eval:~>  ls -l /sbin/init /usr/sbin/init
lrwxrwxrwx 1 root root 26 May 11 20:30 /sbin/init -> ../usr/lib/systemd/systemd
lrwxrwxrwx 1 root root 22 May 11 20:30 /usr/sbin/init -> ../lib/systemd/systemd

@sbradnick - that's unusual, /sbin/init it pretty universally there...

I agree, it's 'different' - but it seems to not pose a problem if a[n extra] check is done for where systemd lives. Not that I have any insight into how WSL2 is checking for anything, but Leap has worked fine how it is in WSL (in the pre-systemd days) as long as I've known it existed.
I'll check if a non-WSL Leap instance is the same way ; maybe we're doing something different when creating the WSL .appx ~ but I doubt it.

Can we get a full official list of "blessed" lookup paths for systemd? We also need it for NixOS, as ours normally lives in /nix/store/<yadda>/<yadda>.

New version (<IP_ADDRESS>) didn't help - actually seems to have made it worse. A fresh install of W11 22H2 w/ an install of Leap 15.4 can't even be saved w/:
[wsl2]
safeMode=true

in C:\Users\<username>\.wslconfig.

on Leap 15.4
lkocman@localhost:/etc/openvpn> ls -l /sbin/init /usr/sbin/init
lrwxrwxrwx 1 root root 26 Aug 18 19:33 /sbin/init -> ../usr/lib/systemd/systemd
lrwxrwxrwx 1 root root 22 Aug 18 19:33 /usr/sbin/init -> ../lib/systemd/systemd

lkocman@localhost:/etc/openvpn> rpm -qf /sbin/init
systemd-sysvinit-249.12-1504<IP_ADDRESS>.x86_64

We most likely need to supply the rpm, or create these symlinks by one of existing packages (e.g. release package for wsl or so).


allowed to change "pk" by "id", by convenience of developer

initially, I was using tastypie as backend for ajax calls, and my javascript templates (with mustache), looks like

so, after, I decided migrate to django-ajax, and I want to avoid override all my javascript templates (id by pk), I love to change things with the less amount of modifications as possible.

I'm going to merge this in, but I'm going to change the setting name to be prefixed with AJAX. I doubt yours will collide, but most apps do this and it seems a bit safer.

Added in 43e8fccbc20832ff483ab1a2b9cbee7368cd0df3.

I'm with you, thanks for having me in mind.


Static checking of module versioning

I have an idea of how to statically enforce that RPC types are versioned. The types there will have something like versioned in their deriving lists. We'll write a ppx for that.
The only other place that annotation can be introduced is via the Make_version and Make_latest_version functors. There should be a way to statically enforce that the annotation
is not other introduced.
The type system will then enforce that RPC types are versioned all the way down.

Implemented by #2020 and subsequent improvements.


Empty html attribute value throws error with Node v14

Describe the bug
When using this plugin with Node v14, an html attribute with an empty value e.g. <div class=""> will throw an error since Array.prototype.at is used here in the parser but is not supported until (I believe) Node v.16.6.0.

Not sure what the minimum node version you're looking to support is, but I'm happy to fix it and submit a PR if this is deemed worth it
Debugging information

OS: Mac
Version 1.2.2

Hi Matt. Node v14 is end of life and we will not support it. I encourage you to update to at least 18, 16 is going end of life in a couple months.
https://nodejs.dev/en/about/releases/


[Bug] paste from curl, query not parse

Overview

Insomnia Version: 5.0.20
Operating System:  MacOS 10.11.4 (15E65)
Summary:  (A few sentences describing the issue. Try to include as much detail as possible.)

insomnia show this,

I want like this

thanks~

@xinshangshangxin there is an Import from Url button at the bottom of the Query tab that can be used for this. It wouldn't be a bad idea to do the import automatically, though, after pasting a Curl command.

thanks~


Add AUTO GENERATED header

Please add an AUTO GENERATED header to alert readers/users of where the content files are located and not to edit this file directly.
https://github.com/AlaskaAirlines/auro-dropdown/blob/36f804fffc4b634f8b5db1411ae0693c59ad39c2/demo/apiExamples.md?plain=1#L1-L5

this has been addressed.


Various bar-related fixes

About the PR

+>plays as punpun once

fixes #13773
fixes soda dispenser window not being wide enough to fit
fixes booze dispenser having copied non-booze reagents from the soda dispenser
fixes smartfridge being unshaded always

Media

[x] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Changelog

:cl:

fix: Fixed condiment stations & smartfridges being too unshaded
tweak: Booze dispenser now only contains booze, everything else it contained was already in the soda dispenser
fix: Fixed soda dispenser UI not being wide enough

thats the part that was glowy in the old unshaded sprite compared to the normal one man i dont make the rules

radioactive napkins


The raw value displays a trailing _

Hello Peter,
After switching to NS 6.0 I started experiencing an issue with the plugin.  When the user enters the information in the text box, the value still contains an extra _ (underscore) character.
Here is a playground link to demonstrate the issue:
https://play.nativescript.org/?template=play-tsc&id=Sv3mjI
Thank you for your help.

Hey @dpdragnev , what platform are you testing? Just tested on iOS (dont have an android device right now) and I dont see the problem.

Sorry, forgot to mention that.  I am using Android.  iOS is fine.

Hey @dpdragnev , I was able to simulate and fix the issue. The fix is now available in the latest version available at ProPlugins.

Thank you @PeterStaev

@PeterStaev I am trying to install it, but I am getting:
npm ERR! 404 Not Found - GET https://registry.npmjs.org/@proplugins%2fnativescript-masked-text-field - Not found
npm ERR! 404
npm ERR! 404  '@proplugins/nativescript-masked-text-field@latest' is not in the npm registry.
npm ERR! 404 You should bug the author to publish it (or use the name yourself!)

I also tried installing it via Sidekick, but I cannot even see the plugin there.
Any suggestion?

@dpdragnev . ProPlugins is a subscription based service. Once you subscribe, you will gain access to the above mentioned private NPM registry.

Got you.  Thanks.

Okay, so in this case - there are no plans to fix this in version available on github? Or are you going to upload it with delay?

@Nevaan , currently I have no plans to upload changes to the public repo/npm. But things might change 😃

Okay, thanks a lot for quick response :) so - maybe you could add some notice that plugin is no longer under development (at least, here)? I believe your plugin is one of few plugins providing input masking feature available on NativeScript marketplace, unfortunately not working properly with Android :(

@Nevaan , this is the first statement in the readme with bold text:

This repo only supports NativeScript pre-6.0. The latest version of the plugin supporting NS 6+ is availble as part of ProPlugins.

oops - you are right. I did not try to use it for NS <6 and somehow skipped this in your statement :)


Unable to submit ticket when Paid support is enabled and helpdesk selected

I noticed there is a new module called Paid support in the version 4.15.1 and I was trying to see whether it will suit my needs but I noticed a bug...
After Paid support plugin is enabled and a specific helpdesk department is checked for Paid support, I am unable to submit ticket as a client.
I will get a blank, white pop up instead of ticket successfully submitted.

Can you elaborate more on this issue? I could not reproduce this error.
Do you have any errors logged in php_error_log file?
What BoxBilling theme you are using?

We will release New BoxBilling minor version later this day fixing this issue

I suppose this means you don't need additional information from me then...?

I have managed to reproduce this error when I left error message blank.

New release is now available to download

I see the error saying Insufficient funds appear when I try to create a ticket as a user but I don't see how the user obtain this fund in the first place....
As usual, the extension site is still missing and there is no guide/document for additional information.

I am sorry for information scarcity, extensions site are under development at the moment.
User can add funds by going to Payments history and entering desired amount in textbox. Invoice will be created and as soon as payment will be received, funds will be added to account.

This works but it seems like this functionality is missing a critical component, i.e. a way to allow user and admin to see how much funds a specific user has left in his account.
After the user used the add funds button and the invoice marked as paid. When logged in as user, going into the Payment history shows nothing there. I can't figure out how the admin can tell how much funds that user account has remaining from this transaction too..

In huraga theme cilent can see its balance in client area. At the moment this information is missing on admin side.
As i can guess you are using boxbilling theme?

Missing item in payment history list - confirmed

As a matter of fact admin is able to see how many funds are in client account. Just go to client manage page Payments tab.
Missing payment item in history fix will be available shortly.

Fix will be included in next major release

Yes, I am using boxbilling theme.
Using boxbilling theme, I don't see anything in Payments tab after the user use add funds and the admin mark it as paid.
I see the user have balance in huraga theme, this still makes no difference for the admin view though. I suppose this is fixed in your new patch?

Payments tab is in admin area in client manage page.

That is the page I was looking at and I don't see anything there after user adding funds via invoice.
The payment tab only shows payment if the payment was added by the admin.


Transition from controllerAs: vm to $ctrl

As referenced in the following issues:

https://github.com/angular/angular.js/commit/d91cf167960d47ce38fec0d33cab6119268623f0
https://github.com/angular/angular.js/issues/13664
https://github.com/angular/angular.js/pull/13710

$ctrl is now the default alias for controllerAs syntax. This pull request converts all references in both generator files and currently existing components to utilize $ctrl instead of vm.
I think that this makes more sense from a project boilerplate standpoint. It's also an approach that @toddmotto recommends: https://github.com/toddmotto/angular-styleguide#controllers

Do not override the default $ctrl alias for the controllerAs syntax, therefore do not use controllerAs anywhere

Good job!


Date field with correct format is marked as type error

Overview
version: v5
Validation following file with correct date format gives error
(https://gist.githubusercontent.com/aborruso/941e9e910d6ab3fb42357cdf417d795a/raw/86bbb2f2452b452b2896857d032096f709f0af15/prezzo_alle_8-20221231.csv)
frictionless validate file.yaml --path prezzo_alle_8-20221231.csv
Error
Type error in the cell "28/12/2022 19:00:07" in row "3" and field "dtComu" at position "5": type is "datetime/%d/%m/%y %H:%M:%S"
# --------
# metadata: prezzo_alle_8-20221001.csv
# --------

name: prezzo_alle_8-20221001
type: table
path: prezzo_alle_8-20221001.csv
scheme: file
format: csv
encoding: utf-8
mediatype: text/csv
dialect:
  headerRows:
    - 2
  csv:
    delimiter: ;
    skipInitialSpace: true
schema:
  fields:
    - name: idImpianto
      type: integer
    - name: descCarburante
      type: string
    - name: prezzo
      type: number
    - name: isSelf
      type: integer
    - name: dtComu
      type: datetime
      format: "%d/%m/%y %H:%M:%S"

@aborruso
@shashigharti
Note that the full year like 2000 is coded as %Y not %y - https://docs.python.org/2/library/datetime.html#strftime-strptime-behavior

Note that the full year like 2000 is coded as %Y not %y - https://docs.python.org/2/library/datetime.html#strftime-strptime-behavior

You are right, it works, and sorry for my error

We're happy to help :smiley:


PLAT-143738: FixedPopupPanels - extra screenshot tests with position=left

Enact-DCO-1.0-Signed-off-by: Adrian Cocoara<EMAIL_ADDRESS>Checklist

[x] I have read and understand the contribution guide
[ ] A CHANGELOG entry is included
[ ] At least one test case is included for this feature or bug fix
[x] Documentation was added or is not needed
[ ] This is an API breaking change

Resolution
Added extra screenshot tests with position=left
Additional Considerations
Links
PLAT-143738
Comments

LGTM


Scene re-generation from JSON deviates from original scene after multiple iterations

Steps to reproduce:

Take snapshot of the scene by specifying inputScenePath in controller.json.
Re-play scene over and over.

Regarding e0cf0b4:
There left no reason for successive re-generations of the scene to deviate from the first re-generation as the program now does not override scene.json if the scene will be generated from JSON.
However, this does not guarantee that scene.json fully provides necessary properties to re-generate a scene correctly.
I'll try out b2djson as well.

I have included b2djson to try out but it needed another dependency named freeglut but I don't want to bloat the codebase with these new dependencies, so I'm dropping b2djson.
I think this issue is solved by e0cf0b4, but we may need to test it more.

output.mpg

output-regen.mpg

output2.mpg

output2-regen.mpg

As of f89f0e4a, moving the Step function did the trick, and after having tested with 6 different cases, I can confirm that this issue is solved. Thanks @tayfunates!


na+sm protocol returns incorrect addrs when looking up addrs concurrently

If I issue concurrent address lookups using na+sm and Argobots ULTs, the addresses get jumbled up on the way out. For instance, say I issue 2 concurrent address lookups for processes with addresses 'na+sm:3000/0' & 'na+sm:3001/0' and Mercury returns corresponding hg_addr_t structures for these addresses. If I send an RPC to the addr returned by the lookup for process 'na+sm:3000/0', it's actually ending up at process 'na+sm:3001/0'. I can confirm this is what's happening by using 'HG_Addr_to_string' to verify the output address being returned by lookup does not match the input string to the call.
I can workaround the issue for now by issuing each addr_lookup serially, which seems to imply the issue is caused by concurrent lookups. I do not see this issue with cci+tcp, so I think it might be specific to the shared memory protocol. That said, shared memory transport should be much quicker and there's a chance it could be exposing a race condition that is not triggered in other protocols in my testing.

@shanedsnyder Let me know if this is fixed

Just checked and it works now. Thanks for the fix!


fix: OpenAI chat

Thank you for contributing to Swarms!
Replace this comment with:

Description: a description of the change,
Issue: the issue # it fixes (if applicable),
Dependencies: any dependencies required for this change,
Tag maintainer: for a quicker response, tag the relevant maintainer (see below),
Twitter handle: we announce bigger features on Twitter.

Please make sure your PR is passing linting and testing before submitting. Run make format, make lint and make test to check this locally.
See contribution guidelines for more information on how to write/run tests, lint, etc:
https://github.com/kyegomez/swarms/blob/master/CONTRIBUTING.md
If you're adding a new integration, please include:

a test for the integration, preferably unit tests that do not rely on network access,
an example notebook showing its use.

Maintainer responsibilities:

General / Misc / if you don't know who to tag<EMAIL_ADDRESS>DataLoaders / VectorStores / Retrievers<EMAIL_ADDRESS>swarms.models<EMAIL_ADDRESS>swarms.memory<EMAIL_ADDRESS>swarms.structures<EMAIL_ADDRESS>
If no one reviews your PR within a few days, feel free to email Kye at<EMAIL_ADDRESS>See contribution guidelines for more information on how to write/run tests, lint, etc: https://github.com/kyegomez/swarms

@ZackBradshaw submit a new pr you are submitting very old commits and code that we have not add in a long time, you are not submitting a pr of just the changes you made making it hard for me to analyze


Wrong bootstrap command for Debian Stretch

Hi,
At the end of init.pp, the bootstrap_galera_cluster initialize the cluster with the command defined in params.pp. The issue is, under Debian Stretch, we get:
$bootstrap_command = 'service mysql start --wsrep_cluster_address=gcomm://'
when really, it should be:
$bootstrap_command = '/usr/bin/galera_new_cluster'
After fixing params.pp, it worked for me with the default mariadb-server and galera-3 packages. FYI, here's the way I called the galera class:
class { 'galera':
galera_servers      => $all_masters_ip,
galera_master       => $first_master,
mysql_package_name  => 'mariadb-server',
vendor_type         => 'mariadb',
root_password       => 'myPaSs',
status_password     => 'myPaSs2',
configure_repo      => false,
configure_firewall  => false,
galera_package_name => 'galera-3',
}
which worked if fixing $bootstrap_command, but didn't by default.

This is true of Ubuntu as well. I worked around it with this code in my profile:
Exec <| title == 'bootstrap_galera_cluster' |> {
  command  => '/usr/bin/mysqld_bootstrap'
}

@gregoryo2014 Thanks for these useful details. Care to submit a pull-request? :)

Sure thing https://github.com/fraenki/puppet-galera/pull/105

A new minor version will be handy - I'm working off a forked version and I'd like to stop doing that!


TEet #2

Describe your changes
Issue ticket number and link
Closes #x
Checklist before requesting a review

[ ] I have performed a self-review of my code
[ ] I have added thorough tests (when necessary).
[ ] I have added the right documentation (when needed). Product update? If yes, write one line about this update.

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b

/ok-to-test sha=de5fa1b


test: pdf build time

@SMoraisAnsys I think we can close this PR, because you are already modifying the documentation build

Closing this as #4284 handles the PDF creation.
@Revathyvenugopal162 Thanks for your help back then, it took us a while to handle everything but we converged with a solution working fine :)


Version bump for ember-string-ishtmlsafe-polyfill

Proposing a version bump from v1.1.0 to v2.0.0.

Some background:
The dependency linter is currently failing builds in my project due to a dependency mismatch on ember-string-ishtmlsafe-polyfill between ember-cp-validations (depends on v1.1.0) and the latest ember-froala-editor (depends on v2.2.0).


Add configurable CIDR ranges for anonymization

Is your feature request related to a problem? Please describe.
The anonymize-ip feature is nice, but it does not provide any flexibility in what is transmitted. In our network, for instance, we anonymize completely for normal queries - we eliminate all IP address data at the moment. Some people may only want to summarize down to the /24 or /16 level, though.
Describe the solution you'd like
Add IPv4 and IPv6 options for setting the CIDR bits to keep in any anonymization transformation process.
Additional context
Here's the simplest example of the additional extensions to anonymization.  I suppose the default behavior can be kept by having the default for anonymize-v4bits as "16" - I don't know what the default bits are for v6 in your current structure or even what would be reasonable.
transforms:
  user-privacy:
    anonymize-ip: true
    anonymize-v4bits: 24
    anonymize-v6bits: 48
    hash-ip: false
    minimaze-qname: false

NOTE: You'll have to execute anonymization after geoIP lookup, otherwise it will lead to very unexpected issues with accuracy in any mapping transforms. You may do that already - just worth mentioning.
Extra credit: There are special cases where we would want to anonymize/aggregate to the BGP-announced prefix level. Adding an additional extension to this and anonymizing to the BGP-advertised prefix would be amazing, but would also require then a source of BGP data.  It might even be possible to read this in from a BGP table dump (unless you wanted to build in a BGP speaker into the code, which would be a significant challenge.)  We use frr, which uses MRT structures (https://docs.frrouting.org/en/latest/packet-dumps.html#packet-binary-dump-format)

PR completed, if you want to remove IP addresses, use the following configuration:
transforms:
  user-privacy:
    anonymize-ip: true
    anonymize-v4bits: "/0"
    anonymize-v6bits: "::/0"

Tested and working as described - thanks!  Tested with various netmasks for v4 and v6.

Completed via #528


Introduce hvpa for gardener-apiserver

What this PR does / why we need it:
Introduce hvpa for gardener-apiserver
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
Release note:

Gardener-apiserver is now scaled by HVPA

The delay in preStop helps give the kube-proxies a chance to propagate the changes to the iptables in all the nodes as noted here.

Great, thanks Gaurav!


Appstudio update test-component-pac-ebxe

Pipelines as Code configuration proposal

Pipelines as Code CI/test-component-pac-ebxe-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
10 seconds
init

✅ Succeeded
19 seconds
clone-repository

✅ Succeeded
27 seconds
build-container

✅ Succeeded
16 seconds
sanity-inspect-image

✅ Succeeded
17 seconds
deprecated-base-image-check

✅ Succeeded
3 minutes
clair-scan

✅ Succeeded
48 seconds
clamav-scan

✅ Succeeded
18 seconds
sbom-json-check

✅ Succeeded
14 seconds
sanity-label-check

✅ Succeeded
14 seconds
sanity-optional-label-check

✅ Succeeded
6 seconds
show-summary

Pipelines as Code CI/test-component-pac-ebxe-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
6 seconds
init

✅ Succeeded
13 seconds
clone-repository

✅ Succeeded
20 seconds
build-container

✅ Succeeded
16 seconds
sanity-inspect-image

✅ Succeeded
16 seconds
deprecated-base-image-check

✅ Succeeded
8 seconds
clair-scan

✅ Succeeded
34 seconds
clamav-scan

✅ Succeeded
9 seconds
sbom-json-check

✅ Succeeded
6 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
sanity-label-check

✅ Succeeded
6 seconds
show-summary

Pipelines as Code CI/test-component-pac-ebxe-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
6 seconds
init

✅ Succeeded
13 seconds
clone-repository

✅ Succeeded
20 seconds
build-container

✅ Succeeded
16 seconds
deprecated-base-image-check

✅ Succeeded
16 seconds
sanity-inspect-image

✅ Succeeded
8 seconds
clair-scan

✅ Succeeded
34 seconds
clamav-scan

✅ Succeeded
9 seconds
sbom-json-check

✅ Succeeded
6 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
sanity-label-check

✅ Succeeded
6 seconds
show-summary


Finished environment mapping is too bright and needs to rotate 180 degrees

Hi!
Must start off by saying that this tool is amazing.
Im having a problem with my finished environment mapping. As the title says, the brightness is too high, is this a problem you are having aswell? The objects are really standing out in the scene. The second issue that I am having is that the environment map needs to be rotated horizontally 180 degrees, which now seems like the alignment of the env map is that of how it was fed to the camera.
Have you encountered these problems before?
Cheers

Hey @joekay, can you share the generated environment map or a screenshot of the resulting 3D objects on your scene? There is currently an issue about handling light and I've been working on it for a while, it will hopefully be fixed in the next release. But I'm not sure if it's the same thing that you are experiencing.
I don't know about the environment map being rotated though, I had not encountered that one before. I will have a look at it.

Hi again and thank you for your answer.
I solved the light issue. I am experimenting with different type of environment maps and was using the base case Apple example, where they include some fiddling with the light environment intensity. I lowered the intensity for the scene light intensity which gave me better results with the realtime env map.
The second issue is still partially there, where the environment map looks good in some angles but not all. Maybe its just limitations with ARKit that can't be avoided if you have experienced the same? Posting two pictures for reference where I have placed a metallic sphere in the room. In the first picture, the glass table is about in the right alignment, but not with the tv in the second picture.


Flash not working correctly

I tried your demo application on a OnePlus 3 and Nexus 5x and the image was not flashed correctly see the attached image. I took the image in a completely dark room with flash enabled.
I was writing kind of the same camera api 3 months ago and had exactly the same issue, but I was not able to fix it. It took me quite a long time to investigate into the issue and find a fix, but I was not able to find a working solution.
OnePlus 3:

Nexus 5x (completely white)

I can repro on Pixel XL, image is overexposed and completely white. It seems there is a synchronization issue between autofocus, flash and the capture itself. I found lots of different stack overflow posts reporting similar things for other devices. It even seems Samsung devices have their own range of issues in regards to flash mode.
I am playing with the Camera2 sample to try to figure out what is the right combination of settings to pick to make this work. But I don't even know if this is possible without manual control of the flash, focus and capture.


replace abandoned istanbul-instrumenter-loader

Fixes #4612
This replaces the only package we consume which has loader-utils as a direct dependency - https://github.com/advisories/GHSA-76p3-8jx3-jpfq. However, loader-utils is a transitive dep of react-scripts as well, hence the whitelist entry in audit.js.
Lastly, I flipped the instrumentation back on for webpack tests.  It does add a couple seconds, but I don't see the hang which was referenced in the comment. We can take it or leave it.

@mergifyio backport release/3.4.x


Single scheme?

Since SwiftyJSON is platform independent, separate scheme is redundant and ugly.

Carthage is using this to checkout and build the scheme independently.

It's not indispensable, see http://promisekit.org/news/2016/08/Multiplatform-Single-Scheme-Xcode-Projects/

A pr for this issue will be appreciated :D

I'm working on it.

I found the Product Bundle Identifier of target SwiftyJSON tvOS Tests is com.tangplin.SwiftyJSON-tvOS-Tests, which is different from the others (com.swiftyjson.$(PRODUCT_NAME:rfc1034identifier)), Why?

there are several inconsistent settings:

target OSX, OSX Tests and tvOS Tests set DEBUG_INFORMATION_FORMAT, but the others didn't.
PRODUCT_NAME of target OSX is $(PROJECT_NAME), the others' is SwiftyJSON.
the most ridiculous, target watchOS uses Info-OSX.plist.


Bugfix/item level upgrade chaos mix

Went into another rabbit hole :smile:

Reviewed chaos mixes
Reviewed & refactored item buying/selling prices (socket items still not OK, will review at a later date)
Added Wizard's Ring's missing wizardry option
Fixed Blue Fenrir's dmg absorption option value
Fixed Dinorant options and serialization
Added guardian options for 380 items for Summoner and Rage Fighter
Fixed DropItemGroup ID's for Dark Raven Spirit and Dark Horse Spirit
Added level 1 for Dark Horse and Dark Raven result craftings

Hey, thanks for all these fixes. We'll need a configuration update plugin to fix existing configurations for that. Can you add this as well?

Hey, thanks for all these fixes. We'll need a configuration update plugin to fix existing configurations for that. Can you add this as well?

Is this not it? Is anything missing?

Ah, I didn't see that, sorry. However, I tried to apply the update and got the following exception:
 Sequence contains no matching element
at System.Linq.ThrowHelper.ThrowNoMatchException()
at System.Linq.Enumerable.Single[TSource](IEnumerable`1 source, Func`2 predicate)
at MUnique.OpenMU.Persistence.Initialization.Updates.FixChaosMixesPlugInSeason6.ApplyAsync(IContext context, GameConfiguration gameConfiguration) in C:\Users\Sven\Documents\GitHub\OpenMU_2\src\Persistence\Initialization\Updates\FixChaosMixesPlugInSeason6.cs:line 348
at MUnique.OpenMU.Persistence.Initialization.Updates.UpdatePlugInBase.ApplyUpdateAsync(IContext context, GameConfiguration gameConfiguration) in C:\Users\Sven\Documents\GitHub\OpenMU_2\src\Persistence\Initialization\Updates\UpdatePlugInBase.cs:line 39
at MUnique.OpenMU.Persistence.Initialization.Updates.DataUpdateService.ApplyUpdatesAsync(IReadOnlyList`1 updates, IProgress`1 progress) in C:\Users\Sven\Documents\GitHub\OpenMU_2\src\Persistence\Initialization\Updates\DataUpdateService.cs:line 80
at MUnique.OpenMU.Web.AdminPanel.Pages.Updates.OnUpdateClickAsync() in C:\Users\Sven\Documents\GitHub\OpenMU_2\src\Web\AdminPanel\Pages\Updates.razor.cs:line 83

Then I tried to apply the update again, and got another error:
Sequence contains no matching element
   at System.Linq.ThrowHelper.ThrowNoMatchException()
   at System.Linq.Enumerable.Single[TSource](IEnumerable`1 source, Func`2 predicate)
   at MUnique.OpenMU.Persistence.Initialization.Updates.FixChaosMixesPlugInSeason6.<ApplyAsync>d__10.MoveNext() in C:\Users\Sven\Documents\GitHub\OpenMU_2\src\Persistence\Initialization\Updates\FixChaosMixesPlugInSeason6.cs:line 55

A config update plugin should never call context.SaveChangesAsync(), so that the update either fails or succeeds as a whole.


merge package from arlac77/npm-package-template

package.json

chore(package<EMAIL_ADDRESS>chore(package<EMAIL_ADDRESS>chore(scripts): cover@#overwrite c8 --temp-directory build/coverage ava && c8 report -r lcov --temp-directory build/coverage
chore(package): add nyc from template
chore(package): set $.ava.require='esm' as in template
chore(package): set $.ava.files='tests/-test.js,tests/-test.mjs' as in template
chore(package): set $.ava.extensions='js,mjs' as in template

Codecov Report

Merging #519 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master   #519   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           1      1
  Lines          29     29
=====================================
  Hits           29     29

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cfc0979...85b309f. Read the comment docs.

Coverage remained the same at 97.619% when pulling 85b309fe044a2c8deec9241093fe35835ece6f12 on template-sync-1 into cfc097944d48991fb013ed1c7251146b05d90f95 on master.


[FEATURE]

canI draw line by mouse event the same as a svg.js ?
var draw = SVG('drawing').size(300, 300)
var rect = draw.rect(100, 100).attr({ fill: '#f06' })

Hi there! How do you mean draw a line by mouse event? Do you have a working example in svg.js?

The svg-container  has hoverable property and clickEvent event emitter. If you add both, then you should see a dot upon mouse hover of the container and upon clicking, you should get x and y coordinates of clicked position. Using those, you should be able to add line to the container.
If this does not solve the issue, please create another issue with more detailed explanation. Closing this one.


Merge changes from landlab/landlab

Description
Merge changes from landlab/landlab

Checklist - did you ...

[ ] Add a news fragment file entry if necessary?
[ ] Add / update tests if necessary?
[ ] Add new / update outdated documentation?
[ ] All tests have passed?
[ ] Formatted code with black?
[ ] Removed lint reported by flake8?
[ ] Sucessful documentation built? (if documentation added or modified)

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

419 of 442 (94.8%)  changed or added relevant lines in 31 files are covered.
5 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.1%) to 85.969%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

landlab/components/lithology/lithology.py
16
17
94.12%

landlab/components/network_sediment_transporter/sediment_pulser_at_links.py
69
70
98.57%

landlab/plot/network_sediment_transporter/locate_parcel_xy.py
0
1
0.0%

landlab/components/network_sediment_transporter/network_sediment_transporter.py
8
10
80.0%

landlab/components/priority_flood_flow_router/priority_flood_flow_router.py
13
15
86.67%

landlab/components/network_sediment_transporter/bed_parcel_initializers.py
129
145
88.97%

Files with Coverage Reduction
New Missed Lines
%

landlab/grid/create_network.py
5
94.59%

Totals

Change from base Build<PHONE_NUMBER>:
0.1%

Covered Lines:
18866

Relevant Lines:
21945

💛  - Coveralls


Change the way people are matched after the party has started

If a user is added to the party after it has been started, the manager is matched with the new participant, and the new participant is matched with the original match of the manager, which spoils the secrecy to some extend. We should change this to first check if there are any participants who haven't yet checked their match. If so, we could use that participant to match against instead of the manager.

I like the idea.

won't fix (developer shortage)


Printing Issue in CustomReportViewer

Hello,
I downloaded your CustomReportViewer project to my local device and attempted to print the demo report, but encountered an issue – it didn't print. Subsequently, I tried to save it on my computer using the printer dialog, and it saved as a PDF. However, when I attempted to open the PDF, I received an error message stating, "We can't open this file. Something went wrong."
Thanks

Hi @AnshQTK that's for Telerik Reporting, not really PDF processing. I didn't vet any of the actual PDF files or data as the idea is to just show that you can create a custom control, add some dependency properties and wire up those properties to the native control. This isn't worth developing any further until the WinUI3 API resolution issue is improved.
If you're still looking for "Printing a PDF file from a WinUI3 project" (which includes .NET MAUI project, because it is a WinUI app on Windows)), then you might want to check out the Telerik UI for WinUI PdfViewer, which has printing support
https://docs.telerik.com/devtools/winui/controls/radpdfviewer/printing
If you are actually trying to use Telerik Reporting support in WinUI3 project, then you can just use the WinUI ReportViewer. See the following docs:

https://docs.telerik.com/reporting/embedding-reports/display-reports-in-applications/winui-3-desktop-application/overview
https://docs.telerik.com/reporting/embedding-reports/display-reports-in-applications/winui-3-desktop-application/how-to-add-report-viewer-to-a-.net-5-application

For help with Telerik Reporting, you can talk to the Telerik Reporting team here => https://www.telerik.com/account/support-center/contact-us/technical-support

I was able to replicate the "Print To PDF" corruption you mentioned.
As far as exporting as PDF goes, there is a System.IO.IOException that occurs. This is probably due to project settings/permissions that need to be added or enabled. You can ask the Telerik Reporting team for help with this, or take a look at their demos source code. It's already installed on your machine if you have Telerik Reporting, go to C:\Program Files (x86)\Progress\Telerik Reporting R3 2023\Examples\CSharp and open CSharp.WinUIExample.VS2022.sln