First party frame resets position on relog

First image is how I move my frames (using Ctrl + Shift). Second image is how they end up after every relog. This happens with no other addons enabled, across all characters.

After a while of asking on the Discord I was finally informed this is "solved" by running as admin.

Actually, that didn't work like I thought it did so I'm reopening this. I tried launching as admin and setting permissions to full access for all users on SavedVariables and the whole twow folder to no avail. Tried fully deleting tdf.lua, as well as ensuring it specifically has full write access for all users. Not sure what else to try at this point.
Seen a few people in #addons-support on the twow discord is having the same issue.

I did some more testing and determined that even with a freshly deleted WTF folder, fresh TWoW install, and all other addons disabled this still happens. Something I noted was on the fresh install is that party frames move as a single unit, but on reload it's only one at a time, as well as the party member 1 frame snapping back into its default position. I also noticed this is happening with the debuff frame too, I just didn't notice because it was hidden behind my minimap and I don't get debuffed enough that I noticed.
I'll try to do some more testing later. It's very weird that it happens on a fresh install. If all the move elements snapped back I'd just assume it's a permissions issue, but it only being some elements suggests something else is happening.


[FLINK-16366] [table] Introduce executeSql method in TableEnvironment and support many statements

What is the purpose of the change
Introduce executeSql method in TableEnvironment and support the following statements: DDL, USE, SHOW. This PR does not involve EXPLAIN, DESCRIBE, INSERT and SELECT, which will be implemented in other PRs
Brief change log

Introduce executeSql method in TableEnvironment
implement each statement for executeSql

Verifying this change
This change added tests and can be verified as follows:

each statement is tested in TableEnvironmentTest for stream TableEnvironment and in BatchTableEnvironmentTest for BatchTableEnvironment

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@flinkbot run travis

I will merge the last three commits into the first one once it's approved

There is an e2e tests failure: "Dependency shading of table modules test"


When a Switch Player Stops Moving, PC Players Emulator (Ryujinx) Stops until the Switch Player Moves Again

I tried connecting without the switch player connected, and now, the game takes so much time to load, and do not let me play when it loads, im stopped until another switch player connects and moves (sometimes, only having the switch player connected works, but if he moves and stops again, we have the main problem).
I tried restarting the server and changing options in ryujinx in the section system and the section multiplayer, but i cannot make it to work properly.

This is my log (i connect with the Switch player connected, then the switch player disconnects and my game freezes, then i closed the emulator with Alt+F4)
Ryujinx_1.0.0-ldn2.4_2022-06-21_03-20-24.log

It happens on stable release too, with ryujinx it doesn't load the stage, and with a switch player joined it loads in ryujinx, but the switch player needs to be moving for the ryujinx player to move if it stops working (looks like a crash but if the switch player moves all works agains, weird.
LOG :
Ryujinx_1.1.151_2022-06-21_03-45-19.log

This sounds like an issue caused by Ryu only having one thread for BSD. Most games use non-blocking sockets on switch, but this mod seems to block on receive, which means that it can't do anything else socket related until that returns (when it gets data, or when the game resets).
You need to revert this PR to overcome the limit... Though it is only a workaround that adds one other thread, and may cause crashes depending on how the service is used.
https://github.com/Ryujinx/Ryujinx/pull/3394

Did you revert the linked PR, build the emulator yourself? I wasn't getting this issue with ryu<->ryu, which would likely be in an even worse situation with freezing.

Did you revert the linked PR, build the emulator yourself? I wasn't getting this issue with ryu<->ryu, which would likely be in an even worse situation with freezing.

Can you share your working build pls?

I was able to get  a Server running with 2 Emu instances running (No switch)
Prs Being used: Vulkan + #3405 + #3394 reverted
https://cdn.discordapp.com/attachments/988461709066924052/988909593159663677/unknown.png

Ok, i did it, and it works fine, so im gonna close this issue.
You can download it at this link: (Link to a Discord message at the Mod Server, if it not works, join the mod server and try again)
https://discord.com/channels/481991664085499924/481993523424395297/988989882351357952

Hey could I get the build? The discord link is not working for me

@parkers0405 https://discord.gg/jYCueK2BqD join the discord and then use the link.


Dismounted Individual Leadership Amplifier

@twornicki
APP-6D 4.2.9 is titled "Leadership Indicator Amplifiers" (Plural), but Table 4-8 is titled "Leadership Indicator Amplifier" (Singular). Table 4-8 only has Leader as an option, but in Table A-8, Leader Individual and Deputy Individual are listed as options.
It also says "Friend" in Table 4-8, but I see no other indication that it is restricted to friendly units.

Hi Joe,
In APP-6(D)(1) there should only be the one dismounted Leadership amplifier. The deputy was dropped during the development of the Dismounted Individual chapter.
The NLD SCP that was GEX agreed at the JSP 19-1 adds a Deputy Leadership amplifier.
However, SCP 19-003-NLD also adds to the leadership amplifier utilising a CDR and SIC Main Icon, providing full flexibility.
APP6D WD4 11MAY2016 (Chapter 4)-SCP_19-XXX-NLD_Soldier Symbology V0_1 .docx

@Twornicki Thanks mate!
@jeconley FYI


simple-cipher: update README to reflect exercise implementation

Clear up the expected implementation details for the simple-cipher
exercise in the README. Provide more explanation of the Vigenère
cipher. Moved README updates into .meta/ directory and regenerated the
README.
Resolves #786

I have to squash all these into one before commit.


Video and audio out of sync/ Video lagging behind audio.

I'm really impressed by the Omnitone examples, except with the audio being out of sync with the video.
The video appears to be going slower that the audio.  If I press pause, when I start playing the video jumps forward to where it is supposed to be.  I thought that it may be an issue with it streaming over the net, so I've tried running the demo off my own via a localhost and still has the same problem.
Is anybody also getting this problem?
I thought that it may be because of ambisonic decoding but you would expect the audio to be behind the video, not the other way round.

The video appears to be going slower that the audio. If I press pause, when I start playing the video jumps forward to where it is supposed to be. I thought that it may be an issue with it streaming over the net, so I've tried running the demo off my own via a localhost and still has the same problem.

I can't reproduce this issue with the current stable version of Chrome. (m53) What's your browser and version?

@fredlemieux Can you provide more information?

@fredlemieux Any feedback? Without triaging the issue properly, it's really hard to fix.

@fredlemieux It has been almost 5 months without feedback, so I am closing this. Please re-open the issue if the problem persists.


Why are my tests failing?

I've created a small mrbgem to demonstrate the problem:
https://github.com/zzak/mruby-test
In this case, I have a simple class:
class MRubyTest
  def initialize
  end

  def say msg
    puts msg
  end
end

git clone git://github.com/zzak/mruby-test.git
cd mruby-test
rake test

You will see:
NoMethodError: it can use puts => undefined method 'puts' for #<MRubyTest:0x7f98a20101e0> (mrbgems: mruby-test)

However, when I compile the binary and use it there is no problem:
./bin/test -e 'MRubyTest.new.say("Hello mruby!")'
#=> Hello mruby!

So I figured out the deal,
For gem to build: you need to add dependency source to build_config.rb
For test to pass: you need to add dependency to mrbgem.rake


Consider alternative for retreiving node hostnames from k8s api.

Related to #252
Most of the sample multinode deployments which are close to a customer-like state are using internal hostnames for communication between nodes. Here is the survey of nodes from agnosticd:
? Select master node  [Use arrows to move, space to select, type to filter]
  infranode1.ci-agnosticd-p-101.internal
> master1.ci-agnosticd-p-101.internal
  node1.ci-agnosticd-p-101.internal

This is how the k8s api sees it. This leads to a following error:
WARN[01 Jul 19 15:33 CEST]/home/dgrigore/Documents/work/openshift/cpma-my/pkg/transform/transform.go:139 github.com/fusor/cpma/pkg/transform.HandleError() Skipping API - Cannot connect to master.ci-agnosticd-p-101.internal:22
: dial tcp: lookup master.ci-agnosticd-p-101.internal on <IP_ADDRESS>:53: no such host

This issue can easily be fixed by specifying the external hostname, which is  master1.ci-agnosticd-p-101.mg.dog8code.com
So the following fixes could be applied:

Add an option to get master node address from user input. (This is how it is fixed now, by substitution of .internal prefix to .mg.dog8code.com)
Find a resource in openshift, which specifies the information we need, and then get the value from API.
Preprovision clusters with external hostnames for nodes (as it is done in quicklab based deployment), and document this step in prerequisites to CPMA.

What is a better solution?

I would view a cluster as having 2 main external interfaces:

API endpoint
Routes endpoint

Other than those 2 endpoints, I don't think we can rely on further external access....assume it will be a case that some configurations may expose more, some less.
Not being able to ssh into masters or nodes will likely be a valid deployment.  Think we will need a flexible approach, where if it's not possible to ssh in a node we need to provide an alternative method of making the needed configuration present, perhaps a fallback of inform end user they need to obtain the needed node configuration files if they want them processed.
Thinking the fallback approach could be:

Rely on user to obtain the needed files (we display via CPMA output the specific files we want fetched)
User stores the files in a directory and then re-runs cpma specifying the dir containing the files.

@jwmatthews Hi John, reading config yamls locally instead of using ssh makes sense. We already have some caching implemented, CPMA reuses fetched files. This behavior can be extended by asking user for source of config files using survey.

@jwmatthews, we're already fetching the files if they are available.
This is documented in Readme, the only case we need to cover is if the path is different then defaults and that's also cover with default values, just need to included into Survey, as @alexander-demichev mentioned.

This has been covered. Please reopen if needed.


Make order of items in mappings deterministic

See highsource/jsonix#34.

Not so critical, postponing.


Additional changes to make CPAOT getCallInfo more similar to Crossgen

After Simon forked away getCallInfo for CPAOT, we landed in a
better position to steer further away from the RyuJit version.
I have split the method getCallInfo into two parts corresponding
to CoreCLR CEEInfo::getCallInfo vs. ZapInfo::getCallInfo and
I refactored the methods to be as similar to their Crossgen
counterparts as possible.
I have also forked embedGenericHandle because its implementation
is differs somewhat between CoreRT and Crossgen. Similarly I had
to provide a separate implementation for
TryResolveConstraintMethodApprox and
ComputeRuntimeLookupForSharedGenericToken.
As part of this effort I had to generalize local method imports
to distinguish between the actual compiled method and its logical
view in the import cell as a shareable instantiated or generic
method may end up in multiple import cells corresponding to
different type parameters or to different values of the
isInstantiatingStub flag.
As a slight cleanup I have also unified parameter ordering such
that, for methods accepting the unboxing / instantiating stub flags
and the signature context, the signature context always goes last.
Thanks
Tomas
P.S. There seems to be a bit of an overlap between Simon's most
recent PR and mine. I assume Simon's change should go in first
and I'll rebase my change after resolving the conflict.
P.P.S. Based on Michal's advice I have also removed the method
ShadowConcreteMethod that is no longer used in CPAOT.
P.P.P.S. This change seems to be fixing about 200 Pri#1 tests.

I have split the method getCallInfo into two parts corresponding to CoreCLR CEEInfo::getCallInfo vs. ZapInfo::getCallInfo

While I understand the motivation (we can just line-by-line rewrite the crossgen parts into CPAOT without having to understand what the code is doing), doing this generally results in code that is harder to read. Crossgen has this structure because it allows to share code with JIT (we call into getCallInfo implementation for JIT and then tweak the result for R2R). We don't have such requirement and doing this in a single pass is more readable and performant.
I'm not going to block on this since this is a business decision, not a technical one (prefer code being written fast, without having to build an understanding of it, and pay the maintenance cost of a legacy codebase over time),

This will be much easier to reason about when SxS debugging with Crossgen - thanks!

I have pushed my current local changes - fix for the incorrect devirtualization issue Simon pointed out at today meeting and one other fix for cross-module inlining of non-versionable methods. I'm still investigating the release bug.

[rebased against upstream/master]


[WFLY-11747] Use capabilities in wildfly-connector instead of deprecated service names

This issue removes the uses of deprecated service names in favor of its capabilities. Additionally, it adds required capabilities for some connector subsystems. This patch will help Galleon to ensure that the provisioned server is correct.
Jira issue: https://issues.jboss.org/browse/WFLY-11747
cc: @maeste

Retest this please


add missing DCO file to repo root

We should have DCO in repo root in each repo. Here it is missing, add it.

/cc @lentzi90 @kashifest @Rozzii

/lgtm


Change internal architecture of storing data

We should migrate to a system where we store each organization in a separate table. This approach will allow us to maintain the logic for searching one, two, or multiple repositories within a single organization. It will also help us narrow down query suggestions to be more relevant to each specific organization.
To start, we should update the code first. Once that's done, we can migrate the data by duplicating it and removing everything that doesn't belong to the organization.

Implementing: https://github.com/manticoresoftware/manticore-github-issue-search/pull/26
Looking for the best way to migrate production database

Fixes TODO:

Update link to point to the correct repository in the "searching in ..." line
Resolve issue with showcase repository
Implement CPU allocation for indexation process
Upgrade backup version

The problem with registryurl can't be fixed in our current setup. The reason? It's in a different repository, but we're searching in another one. We still suggest it because we now store data in the organization's repo.

It's in a different repository, but we're searching in another one. We still suggest it because we now store data in the organization's repo

The context is that we now have a table per-organization to be able to do CALL KEYWORDS/SUGGEST easier. But what if we change the schema to per-repo tables, combine them into per-org distributed tables and then what will be left is to update select fuzzy=1 and call autocomplete, so that we run call suggest to each table separately since unlike call keywords, call suggest can't do it:
mysql> drop table if exists t; create table t(f text) min_infix_len='2'; insert into t values(1, 'abcdef'); drop table if exists t2; create table t2(f text) min_infix_len='2'; insert into t2 values(2, 'abcdefghi'); drop table if exists d; create table d type='distributed' local='t' local='t2'; call suggest('abdef', 'd');
--------------
drop table if exists t
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
create table t(f text) min_infix_len='2'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
insert into t values(1, 'abcdef')
--------------

Query OK, 1 row affected (0.00 sec)

--------------
drop table if exists t2
--------------

Query OK, 0 rows affected (0.01 sec)

--------------
create table t2(f text) min_infix_len='2'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
insert into t2 values(2, 'abcdefghi')
--------------

Query OK, 1 row affected (0.00 sec)

--------------
drop table if exists d
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
create table d type='distributed' local='t' local='t2'
--------------

Query OK, 0 rows affected (0.00 sec)

--------------
call suggest('abdef', 'd')
--------------

ERROR 1064 (42000): no such table d

This task is done, merged into the main branch, and deployed.
As a result of splitting into table-per-repo, I created this task: https://github.com/manticoresoftware/manticore-github-issue-search/issues/27


Remove the output for the cell number 4 at FruitsClassifier360KC.ipnyb

Remove the output from the unzipping operation !unzip master.zip , the output seems to be taking several lines and makes the jupyter notebook unreadable.

issue fixed by pr merge


Feature Request: {Top-Down Character controller}

Description:
The game needs a 2D top-down character sprite, animations and controller for the 'map' section of the game.
User Story:
As a player, I want to control a character sprite so that I can interact with different areas, items, and narrative elements.
Proposed Solution:
I plan on using previous knowledge in 8-directional character animation (Prototyping in Studio 5 / Worldbuilding) to make a simple character for the user. There will be 4 main input directions:

Up (W and ↑ Keys)
Down (S and ↓ Keys)
Left (A and ← Keys)
Right (D and → Keys)

as well as 4 diagonal inputs

Up+Right (W+D and ↑+→ keys )
Up+Left (W+A and ↑+← keys )
Down+Right (S+D and ↓+→ keys )
Down+Left (S+A and ↓+← keys )

Since there is no need to jump, run etc in the main screen, I can get away with a simple movement script that takes these inputs and moves the character at a consistent speed towards that direction (with the correct sprite for that direction).
The new scene I will create will just move the sprite against an empty background as work on map tilesets will be resolved in another issue
Additional Information:
I may look into following a YouTube tutorial to get the animation states correct as it has given me trouble in the past and with the shortened timeframe I would like to get the character sorted quickly, at least for the top down view.

Previous work on 8-directional movement states can be viewed here:
https://github.com/OtagoPolytechnic/RPG-Frontend/issues/15

Closing issue as resolved by PR:

#7


Bug: FlowRunResultsList renders a grid when there are no results

This was fixed by the introduction of t he RowGridLayoutList component in https://github.com/PrefectHQ/prefect-ui-library/pull/1261


[WIP] Feature/osf processor

Overview
It's a draft of the Open Science Framework export script. It works for locations (now set as the table for testing) and other tables.
Questions

We're going to export all our database data? With relationship tables etc? All fields? What a requirements?

Problems

It fails for some trials. I suppose it's because of data size limit or nested data structures. I'll ask OSF developers.

@vitorbaptista please take a look (esp questions)

@roll apart from a few typos and some minor stuff, this looks good to go IMHO.
As a programming style comment, I tend to prefer many small functions over a single big one. I think it improves the readability of the code. For example, in this PR, I would refactor to make it look like:
for trials in _read_trial_groups(conn, limit=limit):
    if _authentication_expired(token_issued_time):
        session.headers['Authorization'] = _authenticate(session)
    _ensure_collection_exists(conf, session)
    _export_trials(trials, conf, session)

With the current code snippets extracted to those functions. I feel it clarifies the code's intention and makes it easier to think in different levels of abstraction (i.e. I can see the actual functions' implementatino if needed, but can easily ignore them).

About functions - I agree about good practice to make code modular but for tasks like this it could lead to increased cognitive complexity for reading/debagging than just plain code. It's because of many state things needed to pass to functions like counters, timers, session, trials etc. So this function will be a really dirty not pure or even "half-pure".

@roll Agreed. That's a sign that this function could be refactored as a class. That's not possible for now, given all the structure around processors, but might be something to keep in mind.

@vitorbaptista
I think we shouldn't dive to deep here (or for similar processors) into any optimizations (performance or code style) because for now it looks like more like one-time thing (may be before next iteration but anyway).
A real game changer could be this one - https://github.com/opentrials/opentrials/issues/180 - if we will be having time for refactoring.


Fix curl on API server start error

Additional fix for https://github.com/kubernetes-incubator/service-catalog/pull/991
/cc @MHBauer

LGTM


RoleAssignmentUpdateNotPermitted upon deployment using Powershell

Hi,
I tried deploying via the powershell deployment (i reverted back to known working version 2.30.0 of the Azure CLI to get around the Entra App registration errors), but i am getting the following error when it tries to deploy the Azure resources:
[   {     "additionalInfo": null,     "code": "BadRequest",     "details": [       {         "additionalInfo": null,         "code": null,         "details": null,         "message": "There was a conflict. Conflict with existing ScmType: ExternalGit",         "target": null       },       {         "additionalInfo": null,         "code": "BadRequest",         "details": null,         "message": null,         "target": null       },       {         "additionalInfo": null,         "code": null,         "details": null,         "message": null,         "target": null       }     ],     "message": "There was a conflict. Conflict with existing ScmType: ExternalGit",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   },   {     "additionalInfo": null,     "code": "RoleAssignmentUpdateNotPermitted",     "details": null,     "message": "Tenant ID, application ID, principal ID, and scope are not allowed to be updated.",     "target": null   } ]

Hi @seddon ,
Thanks for raising the query. Please follow this troubleshooting guide-2nd question to overcome this issue.


BccPagination

Change summary
Added BccPagination
Change type

[ ] No review
[ ] Small PR
[ ] Big PR
[ ] Refactor

Closes #ISSUE_NUMBER or Part of #ISSUE_NUMBER

@laurensgroeneveld Kunne du sjekke denne?

@laurensgroeneveld i'm wondering about if the Table in pagination storybook should be kept or removed like with the Radix Vue version where i only show the component itself.

I think that's fine, then when we add pagination support to the Table component itself it can instead be shown there.
I didn't add a comment on it before, but you could even add a few stories showing some different options at a glance, like if you hide the page selector, alignment etc.


about ava_eval_helper.py

the code in lib/utils/avaeval_helper.py
`from utils.ava_evaluation import object_detection_evaluation .
from utils.ava_evaluation import standard_fields`
but I cannot find the 'utils.ava_evaluation' file,can you give me some help?

Please follow the instruction in
https://github.com/facebookresearch/video-long-term-feature-banks/blob/8953fe040ce142c4480840af535d2f497d7c1b1f/dataset_tools/ava/download_annotations.sh

Thank you for your prompt reply


Some time onPushCall function not calling

I have configured push notification in my app and when my app in background and socket disconnected then I’ll receiving notification but onPushCall method not calling.

2023-08-24 still not working.
I can get an incoming push call, but clicking the answer button doesn't work and no callback is triggered.
However, if I click the answer button within the app, it works and I can answer the call normally.
device: IPHONE6S
IOS Version: 15.6

I'm Facing the same issues.  Foreground Calls work but background only works within 5 secs of the app closing.

sad .... I've been talking to their tech team for quite some time now, but there's been no reply<EMAIL_ADDRESS>

@fatpo This issue has been resolved. Please confirm so the issue gets closed.

@isaacakakpo1 hi there, So was it fixed in version 0.1.16? I think "killing the app and not receiving incoming calls" should be a backend issue? Is it related to the IOS SDK?

i think it's fixed now.

iOS version: 17.4
Telnyx iOS SDK version: 0.1.21
Issue: I have actually been reporting this issue for over six months now, starting from October 1, 2023. The call answering feature doesn't work when the app is minimized or killed.
If the app is killed and someone calls, it can receive push notifications, but tapping on the notification doesn't take you to the call screen.
If the app is in the foreground, it can receive incoming calls and function normally.
If the app is minimized (in the background), it cannot receive push notifications.
In summary, the call answering feature only works when the app is in the foreground.


missing folder

Thanks for sharing this project. However, I noticed an issue with a missing folder.
As introduced in README, there should be the following folder in the repo but I could not find it:
"kbembeddings: code forked and adapted from https://github.com/thunlp/KB2E"

Hello, sorry for the confusing.
I am preparing the code for the camera ready I am making a new version of the whole repo atm again.

Thanks much for the quick response!
I noticed that script "prepare_repo.sh" have been added and folder "./kbembeddings" have been included. Looking forward to the new version of the repo.

sure now you can add
self.USE_PRETRAINED_KB_EMBEDDINGS =True
And start training with pretrained KB embeddings as well.
Pretrained word embeddings are on the way.


Crawling packages fails on Windows machine.

Hey,
crawling suddenly fails on my windows machine (I am usually using Linux).
At first it worked but now I cannot get it to work ever. I even reinstalled ROS2-Humble and cleaned my environments.

I have reinstalled python and created a virtual environment.

Installed all neccessary ROS2_Humble packages and colcon-common-extensions.

I source Visual Studio env and ROS2.

Go into my workspace and do "colcon build --symlink-install" as usual and it won't find any packages even though my packages are located there and it should find them when searching the folders recursively. On my other workstation (Linux) it always works.

At first it failed silently but in the trial within a fresh venv I got:
(venv-minirov) PS F:\ros2_humble\ros2_ws> colcon build --symlink-install

Summary: 0 packages finished [0.14s]
WNDPROC return value cannot be converted to LRESULT
TypeError: WPARAM is simple, so must be an int object (got NoneType)

Can you please take a look at the verbose output using colcon --log-level debug list or the like? It might be too much output to post here, but maybe the first several lines would be helpful.

First, I had spaces in my setup.bat causing some variables not getting set (ie set myVar = "path/to/env.bat" failed due to the spaces around the assignment operator..... set myVar="path/to/env.bat". This out of the way I found that
--symlink-install doesn't report as much as a normal copy install does. When I tried once again it showed me that I forgot to run the VisualStudio environment beforehand so that VisualStudioVersion is set.
Now that I run the vcvarsall.bat x86_64 it finds my packages.
However, I encountered some other issues with python linking unrelated to colcon but ros2 using a virtual python env and some libraries like em conflicting with empy and after hours I gave up on Windows and just created VM for now.
Sadly WSL2 is too unstable still (Already have that behind me. Even build a custom linux kernel for getting xbox controllers to work with that crappy xbox interface).
I will just stop trying to make Windows work for anything outside of the C# Asp.Net domain. Just not worth the hassle.
Might just create a dual-boot later.
I wrote this just so if anyone is trying to make Windows work for anything related to science. Stop.
Thanks for the help.

log from F:\ros2_humble\ros2_ws\log\list_2022-12-21_10-55-02

This output suggests that the working directory (F:\ros2_humble\ros2_ws) contains an ignore marker, which explains the behavior you're experiencing.
Is it possible that you attempted to set the --install-base or --build-base to that directory instead of a subdirectory, which would have automatically created an ignore marker?

I had spaces in my setup.bat causing some variables not getting set

This sounds like a bug to me, but I can't find any such occurrences across any colcon or ament packages. Can you help me track it down?

...I found that --symlink-install doesn't report as much as a normal copy install does.

This shouldn't be the case, especially for CMake projects. I'm not booted into Windows right now so I can't give it a shot, but the console output on Linux is identical for --symlink-install, except that the Installing messages are replaced with Symlinking ones.
I'd like to encourage you to try following the official build guide for ROS 2 on Windows. I've personally run through these instructions recently and was able to compile ROS 2 successfully.

Yes, I am usually setting --install-base and --build-base to my ros2_ws and source my package setup script. I have done so on my Linux workstation as well without issues. Indeed I was wondering why it always created a COLCON_IGNORE after I called colcon build. Is there something in the docs about that?

I had spaces in my setup.bat causing some variables not getting set

This sounds like a bug to me, but I can't find any such occurrences across any colcon or ament packages. Can you help me track it down?

Don't worry. That's just a batch syntax thing. Simply removing the spaces around the assignment fixed it.

I'd like to encourage you to try following the official build guide for ROS 2 on Windows. I've personally run through these instructions recently and was able to compile ROS 2 successfully.

I am usually following these instructions, thank you. I might have forgotten to install the xmllint stuff under Install miscellaneous prerequisites.
After I cleaned my entire Windows machine I gave it another go and now it seems to build.


local for another lang

hi, im use ionic 2 and angular2
how use angular2-moment for persian lnaguage in app.module
@NgModule({
    declarations: [declarations()
        , LimitLangDirective
        , AndroidButtonDirective
        , TruncatePipe
    ],
    imports: [
        BrowserModule,
        MomentModule ,
        HttpModule,
        TranslateModule.forRoot({
            loader: {
                provide: TranslateLoader,
                useFactory: HttpLoaderFactory,
                deps: [Http]
            }
        }),

        IonicStorageModule.forRoot()
    ],
    bootstrap: [IonicApp],
    entryComponents: entryComponents(),
    providers: providers()
})

plz help me

I success to change language (ionic 3).

do install moment npm install --save moment
in module do import in NgModule file:

    import { MomentModule } from 'angular2-moment';
    import 'moment/locale/vi';

I use this to change the language in angular 4 application:
import * as moment  from 'moment';
moment.locale('ru');

I'm using it, but amDateFormat doesn't respect locale....

Agree, it doesn't respect that...

any plans to implement this functionality ?

@urish I sent the PR https://github.com/urish/ngx-moment/pull/187 a while ago. Now with the change of the build process the same problem occurs and it could probably solved in a similar way. Tested only locally, but if you move moment from the dependencies into devDependencies it should not install moment as own dependency so it uses the global one and you can set the local with in a more natural way with
import * as moment  from 'moment';
moment.locale('de');

We fixed it temporarily with with the postinstall in the package.json
scripts: {
...
    "postinstall": "yarn run fix-moment",
    "fix-moment": "rimraf ./node_modules/ngx-moment/node_modules/moment",

Then
import * as moment  from 'moment';
moment.locale('de');

works again

I think the best solution would be to have moment as a peerDependency, WDYT @wachri ?

With the previous version this hasn't worked, but now this should be the solution :).

released as 3.0.0

@urish  Locale still not working properly in 3.1.0. Doesn't seem to change until the next change detection.


Do you plan to support multiple wireguard interfaces?

Thank you for this fine piece of software. I've been searching for a simple and user friendly wireguard GUI for some time and I think I may have found it now.
Out of curiosity I wanted to ask, if you plan to implement multiple wireguard interfaces / multiple address ranges in the future? Where I could assign different users to different nets with different rules. Maybe even assign different devices of the same user to different nets.

Hey @svenito92 absolutely. It's a feature request we've gotten in different channels a few times. Things have been crazy these past few weeks, but we plan to have this within the next major release or two.
Thanks for the suggestion!

Thanks @jamilbk for the quick reaction.
Nice to hear that! In the mean time I will probably just use multiple instances of firezone on individual VMs.
I want to point out , that I really like your installation script, that makes installation so easy. As fond as I am of Docker, for this kind of security relevant service I prefer a separate VM with only firezone on it. So docker would only be an additional layer to maintain in my case. So thanks for providing so easy installation!


update(plugins): bump Go sdk version

Signed-off-by: Michele Zuccala<EMAIL_ADDRESS>What type of PR is this?
/kind cleanup
Any specific area of the project related to this PR?
/area plugins
/area build
What this PR does / why we need it:
Which issue(s) this PR fixes:
N/A
Special notes for your reviewer:

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: zuc
To complete the pull request process, please assign ldegio after the PR has been reviewed.
You can assign the PR to them by writing /assign @ldegio in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: jasondellaluce, zuc
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [jasondellaluce]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


fix(cli): avoid crashing when no user config directory is present.

Summary
This PR solves the crash that happens when no ~/.elide directory is present.
Fixes #469

great work 👍🏻


[Bug][UI Next][V1.0.0-Alpha] Missing the default option for the tenant select when saving a process.

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
When saving a process the component of tenant select didn't use any default option. But the tenant option must be required or the operation of saving the process won't be successful.  In the old UI , the component of the tenant select has a default option.
In the new UI, the form seems like:

In the old UI, the form seems like:

What you expected to happen
I expect that the component of the tenant select has a default option.
How to reproduce
You can create a new process and then you will see this problem when you're saving the process without any tenant.
Anything else
No response
Version
dev
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I'll work out this issue.

This issue can't be reproduced again. So close this issue.


Botaneer Issue 1 - Zooming ruining grid/pot creation positioning

Whenever a zoom is used at different positions (relative to the pot grid), some grid lines will become misaligned. I outlined a possible fix in Botaneer patch 2 (#3), where rounding the decimal from the x and y positioning after centralization may keep a consistent integer each time. This can be accomplished by using math.ceil or math.floor to always round up/down values.

After looking it over, it actually seems like an issue from the inverse_scaling method where it multiplies each rect property with a decimal.


Default handler mapping is unusable

Hi,
In the code snippet, I've quoted below, you are registering a default mapping "/debug/health" for the DefaultServerMux:
// Registers global /debug/health api endpoint, creates default registry
func init() {
    DefaultRegistry = NewRegistry()
    http.HandleFunc("/debug/health", StatusHandler)
}

Actually, it makes the healthcheck projects unusable (even hackable) with non-standard HTTP server usages. Imagine than I may be want to publish the /debug/health endpoint for my internal HTTP server, not the production one (yup, the app starts two webservers). That's the first issue.
Secondly, you've hardcoded the "/debug/health" mapping which also implies additional adjustments in client projects (f. e. "/debug/health" doesn't suit me at all ;).
In fact I can patch the DefaultServeMux after importing, but that's hacking the import lifecycle not a clean design.
Please rethink using the function init, registering endpoint for DefaultServeMux and hardcoding the handler mapping.

@mtojek This is the exact pattern used in the standard library for /debug/* packages. https://golang.org/src/net/http/pprof/pprof.go#L66 is an example.
You can mount the health endpoint any where you want with the exported StatusHandler symbol.
We do everything you're describing and more.
You're problem is using the default serve mux as your "production" server. Because routes are implicitly registered using standard packages, using the default serve mux can be a bit of a liability.


encodeUrl and punycode

Hello,
when I use mediaelement in a website which has a domain in punycode, it's seems that mediaelement encode the url and it's not possible to read the video file.
Only on FF. I don't have this problem in Chrome and Safari.
Is somebody have this problem ?

@hmonglee  Is this still an issue?

@hmonglee Closing old issues. If you'd like to reopen this, let us know. Thanks!


[SUPPORT] Materializing nullable ShortType columns throws NullPointerException

Describe the problem you faced
On AWS EMR 6.12 + 6.11.1 (running Hudi 0.13.0-amzn-0 + Spark 3.4.0/3.3.2), we are getting a NullPointerException when attempting to materialize (count or save) a result generated from an existing Hudi lake that has a nullable "integer" column that was converted from its' original type of "short".
The Hudi lake was generated with EMR 6.12 with no problem. My original field had a parquet type of "ShortType" which was loaded into the Hudi table as "IntegerType" (see  But when we read a field that was originally "ShortType" and has both null and non-null values, we get a NullPointerException.
We can materialize the same column using EMR 6.9 (running Hudi 0.12.1-amzn-0 + Spark 3.3.0). So our users have had to downgrade their applications in order to use this table properly.
Why are nullable fields that were originally short and so converted to integer by Hudi failing when we have null values? Is there a workaround to use latest version of Hudi but also use this column?
To Reproduce
Steps to reproduce the behavior:
val schema = StructType(Array(
    StructField("datasource",StringType,true),
    StructField("id",IntegerType,true),
    StructField("shortid",ShortType,true),
    StructField("longid",LongType,true)
))

val data = Seq(
    Row("partition1", 11, 1011.asInstanceOf[Short], 10000011L),
    Row("partition1", 22, 2011.asInstanceOf[Short], 20000011L),
    Row("partition1", 33, null, 30000011L),
    Row("partition1", 44, 4011.asInstanceOf[Short], null)
)

var df = spark.createDataFrame(spark.sparkContext.parallelize(data), schema)

df.count //Returns 4

df.write.format("hudi").
  option(PRECOMBINE_FIELD_OPT_KEY, "id").
  option(RECORDKEY_FIELD_OPT_KEY, "id").
  option(PARTITIONPATH_FIELD_OPT_KEY, "datasource").
  option(OPERATION_OPT_KEY, "bulk_insert").
  option(TABLE_NAME, "test.all_hudi").
  mode(Append).
  save("s3://hudi-lake/hudi-table")

val loaded_df = spark.read.format("hudi").load("s3://hudi-lake/hudi-table")

loaded_df.printSchema
//   root
//     |-- _hoodie_commit_time: string (nullable = true)
//     |-- _hoodie_commit_seqno: string (nullable = true)
//     |-- _hoodie_record_key: string (nullable = true)
//     |-- _hoodie_partition_path: string (nullable = true)
//     |-- _hoodie_file_name: string (nullable = true)
//     |-- id: integer (nullable = true)
//     |-- shortid: integer (nullable = true)
//     |-- longid: long (nullable = true)
//     |-- datasource: string (nullable = true)

//NULL POINTER EXCEPTION:
loaded_df.groupBy("shortid").count.sort(col("count").desc).show(1000,false)

Expected behavior
I expect my nullable short columns to be able to be materialized regardless of if there is null values or not.
I understand Hudi is converting base Spark ShortTypes -> IntegerType. This is expected, but it should not fail when attempting to materialize the "shortid" field.
Environment Description

Hudi version : 0.13.1-amzn-0

Spark version : 3.4.0 + 3.3.2

Hive version : 3.1.3

Hadoop version : 3.3.3

Storage (HDFS/S3/GCS..) : S3

Running on Docker? (yes/no) : No

Additional context
Tested on AWS EMR 6.12, 6.11.1, 6.11.0, 6.10.0, and 6.9.0. Only 6.9.0 and 6.10.0 were successful so this appears to be a regression.
Maybe related to https://github.com/apache/hudi/issues/4233 ? Not sure because this is working in older versions but not in the latest and greatest code.
Stacktrace
23/10/10 15:51:39 ERROR Utils: Aborting task
java.lang.NullPointerException: null
    at org.apache.spark.sql.execution.vectorized.OnHeapColumnVector.getInt(OnHeapColumnVector.java:314) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.vectorized.ColumnarBatchRow.getInt(ColumnarBatchRow.java:106) ~[spark-catalyst_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source) ~[?:?]
    at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:35) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.hasNext(Unknown Source) ~[?:?]
    at org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:959) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.execution.datasources.FileFormatDataWriter.writeWithIterator(FileFormatDataWriter.scala:91) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.execution.datasources.FileFormatWriter$.$anonfun$executeTask$1(FileFormatWriter.scala:404) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1575) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.execution.datasources.FileFormatWriter$.executeTask(FileFormatWriter.scala:411) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.sql.execution.datasources.WriteFilesExec.$anonfun$doExecuteWrite$1(WriteFiles.scala:100) ~[spark-sql_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2(RDD.scala:888) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2$adapted(RDD.scala:888) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:364) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.rdd.RDD.iterator(RDD.scala:328) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:92) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:161) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.scheduler.Task.run(Task.scala:141) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:554) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1541) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:557) ~[spark-core_2.12-3.4.0-amzn-0.jar:3.4.0-amzn-0]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_382]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_382]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_382]

Why a short type could be null?

@noahtaite Thanks for raising this issue. I confirmed that hudi is not handling Short Types well. Even it is not related to if it is nullable or not. This is working well with other file formats.
Created JIRA for the same - https://issues.apache.org/jira/browse/HUDI-6936
val schema = StructType(Array(
    StructField("datasource",StringType,true),
    StructField("id",IntegerType,true),
    StructField("shortid",ShortType,false),
    StructField("longid",LongType,true)
))

val data = Seq(
    Row("partition1", 11, 1011.asInstanceOf[Short], 10000011L),
    Row("partition1", 22, 2011.asInstanceOf[Short], 20000011L),
    Row("partition1", 33, 2012.asInstanceOf[Short], 30000011L)
)

var df = spark.createDataFrame(spark.sparkContext.parallelize(data), schema)

df.count //Returns 4
val path = "file:///tmp/test_hudi40"

df.write.format("hudi").
  option(PRECOMBINE_FIELD_OPT_KEY, "id").
  option(RECORDKEY_FIELD_OPT_KEY, "id").
  option(PARTITIONPATH_FIELD_OPT_KEY, "datasource").
  option(OPERATION_OPT_KEY, "bulk_insert").
  option(TABLE_NAME, "test.all_hudi").
  mode(Append).
  save(path)

val loaded_df = spark.read.format("hudi").load(path)
loaded_df.printSchema

root
 |-- _hoodie_commit_time: string (nullable = true)
 |-- _hoodie_commit_seqno: string (nullable = true)
 |-- _hoodie_record_key: string (nullable = true)
 |-- _hoodie_partition_path: string (nullable = true)
 |-- _hoodie_file_name: string (nullable = true)
 |-- id: integer (nullable = true)
 |-- shortid: integer (nullable = false)
 |-- longid: long (nullable = true)
 |-- datasource: string (nullable = true)

loaded_df.show()

Hello @danny0405 we are ingesting from ~300 tables in ~2k customer databases which are not fully constrained - we can expect to see null values in many fields. In this case I believe it is a missing linking ID.
@ad1happy2go happy to hear you have reproduced the issue, looking forward to hearing about a workaround and timeline for fix.
Two things to note
1 -  I also reproduced this issue with ByteType which it seems that Hudi is handling exact same as ShortType
2 - Our current workaround (temp + hacky) is to convert all incoming ShortType + ByteType to IntegerType before saving to Hudi. This is working in our dev environment.


Use enable_custom_components fixture

Worked locally

@tetienne are you able to start the workflow here?

This PR https://github.com/home-assistant/core/pull/43692 broke your usage of loading custom integrations, but I'm not quite sure why it didn't break all usage of custom integrations in tests.


Preparing Image for simulation

I am a little unclear on the workflow to correctly generate a docker image and upload to the Dreamland simulation platform. Following the guidance in the How To Build and Release, I believe I have correctly generated a release image.
On the Dreamland user manual there is a process described to commit a new docker image. In the directions, it describes logging into a specific Apollo docker registry and pulling down the base docker image, then modifying it with a "sim_op" directory and a few other items, and then doing a commit of that modified image.
Given this, it is confusing to me how I would upload my own generated image. Also, while the user manual describes the main elements that need to be modified to get an image to run in Dreamland I can't seem to find a full example of the modifications (even when I pull the base image from the server referred to in the user manual it does not contain these folders/files). I'm relatively new to both Apollo and docker so if anyone can help walk me through the process to even take an unmodified image of the Apollo release and just download, generate, and upload to Dreamland for testing it would be very helpful.

Hi LunaAmour, thank you for using dreamland.  We are going to release a new version of dreamland at the beginning of Jan, 2018, which allows you to deploy your code by entering a github url and a branch name.  So it would be much more convenient then and no image or binary is needed.

Hi Tim,
That is fantastic news, and should be very useful for our further development. I will look forward to seeing the new version. Will there be an official announcement when it is released and a readme on how to use the new options?
Cheers,
Alex

From: Tim<EMAIL_ADDRESS>Sent: Wednesday, December 13, 2017 12:47:39 PM
To: ApolloAuto/apollo
Cc: Alex Stimpson; Author
Subject: Re: [ApolloAuto/apollo] Preparing Image for simulation (#1752)
Hi LunaAmour, thank you for using dreamland. We are going to release a new version of dreamland at the beginning of Jan, 2018, which allows you to deploy your code by entering a github url and a branch name. So it would be much more convenient then and no image or binary is needed.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/ApolloAuto/apollo/issues/1752#issuecomment-351468331, or mute the threadhttps://github.com/notifications/unsubscribe-auth/Ag4YW0jWhrPrCFwpRANIAPINrkI4pvEQks5tAA26gaJpZM4RA1XM.

Hi Alex,
There will be an official announcement. New update will be announced during Baidu AI Create at Las Vegas on Jan 8th, 2018. If you and your colleagues will go to CES 2018, we would love to extend our invite to Apollo developers like you.
Here is the link to the event registration if you are interested in attending: [https://www.eventbrite.com/e/baidu-ai-create-at-las-vegas-tickets-41091507806]
Please let me know if you have any additional question about the event. Hope we can see you there!
Best,
Zhenni
Community Manager of Apollo

Thanks for the link! I'll see if I can personally make it and will certainly check if we will have a rep there.

Sounds good! Feel free to share the link to your colleagues or any other Apollo developers that might be interested! :)


[Bug] [config-ui] Connection Save too slowly

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
Connection Save too slowly. It's always 2s even thouth it's in local network.
What you expected to happen

Save success when api response.
How to reproduce

create a connection and save it.
look how long it succeed.

Anything else
No response
Version
main
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I think the reason of this issue is ToastNotification.clear() in other network request

This is not a bug there must be some specific reason this is wrapped in a timeout, most likely for UI latency.

The api request function should return when success and only return slowly when timeout?


docs: fix background image

closes #67

It's seems the picture will be broken on Github.  Not sure if there is a way to keep both side.


Data Import Suggestions

[ ] Having drag and drop support for adding more files (after the initial uploaded file) would be nice
[ ] If possible, can we hide the scrollbars in the import UI if they are not necessary, found them a little distracting
[ ] For rel table, my first intuition was to turn "Import to Table?" off for columns that are used as keys since importing to table suggests it is added as a column, so I wonder if import to table and use as key should be mutually exclusive

Screenshot for the scrollbar

Fixed in #206


Confusion about npm releases

Looking at npmjs https://www.npmjs.com/package/node-resemble-js it seems there only a release tagged with 0.2.0 available.
In your repo I see only 1.0.1, 1.1.0, 1.1.1 tagged.
While your fork source (https://github.com/rsmbl/Resemble.js) has tagged releases up to 3.2.4.

Is there any plan to bublish the current releases (1.x) to npmjs?
are there any updated planed to match the fork source?
Is there any relation between your tags and the sources tags?

@mirzazeyrek @lksv The master branch now pulls in<EMAIL_ADDRESS>Can you consider releasing a new version with a dependency on<EMAIL_ADDRESS>The latest available version (0.2.0) is using<EMAIL_ADDRESS>which has a bug reported on https://github.com/garris/BackstopJS/issues/350. Releasing a new version would fix this issue.

new


Docker compose support?

Have anyone had any luck getting this running using Docker Compose versus Docker run?
I was able to translate most of the run command into a compose file, but is stuck at the "echo <key> | starter" part. (compose file WIP below)
Looking at the shell script "starter" (/etc/adallom/scripts/starter) if we could check if the TOKEN variable exists as an environmental variable then we could pass this token by using an environment option in our Docker Compose script (or as a " -e 'TOKEN=xxxxx' " flag in the Docker run command).
Right now the only way I got it working is by logging in to the container and running "starter <<< <key>" which is not optimal as it has to be re-run each time the container is rebuilt.

/etc/adallom/scripts/starter (Before)
#!/bin/bash
first_run() {
echo "Setting environment"
read TOKEN

/etc/adallom/scripts/starter (Suggested)
#!/bin/bash
first_run() {
echo "Setting environment"
if [ -z "$TOKEN" ]
then
read TOKEN
fi

Docker Compose File
version: '3.5'
services:
caslogcollector:
image: microsoft/caslogcollector:latest
container_name: Log-Collector
restart: always
ports:
- '21:21'
- '601:601/tcp'
- '20000-20099:20000-20099'
environment:
- PUBLICIP=xx.xx.xx.xx
- PROXY=
- SYSLOG=true
- CONSOLE=xxxxxx.us2.portal.cloudappsecurity.com
- COLLECTOR=Log-Collector
security_opt:
- apparmor:unconfined
cap_add:
- SYS_ADMIN
stdin_open: true
tty: true

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e21ac1e4-295d-74f4-8217-087203c54bb7
Version Independent ID: 229ddf62-fd89-8e05-a55a-6a894a57c13a
Content: Configure automatic log upload for continuous reports
Content Source: CloudAppSecurityDocs/discovery-docker-ubuntu.md
Service: cloud-app-security
GitHub Login: @rkarlin
Microsoft Alias: rkarlin

I modified the "starter" bash script, rebuilt the container image and was able to pass my token as a variable, allowing for a non interactive deployment of the container.
Steps:

Docker run command from step 2.5 in the guide above.

docker exec -ti Log-Collector /bin/bash

vim /etc/adallom/scripts/starter

Replace first few lines with:
#!/bin/bash
first_run() {
echo "Setting environment"
if [ -z $TOKEN ]; then
read TOKEN
fi

exit

docker commit Log-Collector microsoft/caslogcollector:latest-modified

docker-compose -f docker-compose.yml up

Docker Compose File (docker-compose.yml)
version: '3.5'
services:
caslogcollector:
image: microsoft/caslogcollector:latest-modified
container_name: Log-Collector
restart: always
ports:
- '21:21'
- '601:601/tcp'
- '514-515:514-515/udp'
- '20000-20099:20000-20099'
environment:
- PUBLICIP=xxx.xxx.xxx.xxx
- PROXY=
- SYSLOG=true
- CONSOLE=xxxxxxx.us2.portal.cloudappsecurity.com
- COLLECTOR=Log-Collector
- TOKEN=xxxxxxxx
security_opt:
- apparmor:unconfined
cap_add:
- SYS_ADMIN
stdin_open: true
tty: true

thanks @marcusit ! I've passed this off to our dev team to see if there's something they want to update.

In case anyone stumbles across this in the future, the following docker-compose.yml works without having to rebuild the image. This keeps the solution within the spirit of Docker containers remaining ephemeral so that they continue to work when the image is updated or re-built while still keeping secrets somewhat protected.
Docker Compose File (docker-compose.yml)
services:
  mcas:
    image: mcr.microsoft.com/mcas/logcollector:latest
    container_name: mcas
    restart: unless-stopped
    ports:
      - 2121:21
      - 6514:601
      - 20000-20099:20000-20099
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /etc/ssl/certs:/etc/ssl/certs:ro
      - ./.secrets/certs:/etc/ssl/private:ro
      - ./.secrets/default_ftppass:/etc/adallom/config/default_ftppass:ro
      - ./.secrets/api_key:/root/api_key:ro
      - ./logs/pure-ftpd:/var/log/pure-ftpd
      - ./logs/syslog.debug:/var/log/syslog.debug
      - ./logs/supervisor:/var/log/supervisor
      - ./logs/adallom:/var/log/adallom
    environment:
      - TZ=America/Chicago
      - PUBLICIP=mcas-hq.ad.skybirch.com
      - SYSLOG=true
      - INCLUDE_TLS=on
      - CONSOLE=skybirch.us3.portal.cloudappsecurity.com
      - COLLECTOR=MCAS-HQ
      - FTPUSER=mcas
    command: /bin/bash -c "cat /root/api_key | /etc/adallom/scripts/starter"

Note that this config omits the security_opt and cap_add elements which are not needed and are not a good Docker security practice.
It also allows for setting a custom FTP username and password, brings in the necessary TLS certificates from the host, and saves the log files outside the container. As with all docker volume mapping, the requisite files and folders need to be added on the host beforehand including the ca.pem, server-cert.pem, server-key.pem, and pure-ftpd.pem files in ./.secrets/certs. Also, be sure your .gitignore file is set to exclude .secrets/ and logs/ from the repo.
On a final note, the API key can also be brought in by pulling out /etc/adallom/config/columbusUser.cfg from a working image and mapping it via the volumes element which precludes the need to override the container's default command.


An error occurred while using the Create-React app

react-refresh-runtime.development.js:465 Uncaught TypeError: Cannot read property 'forEach' of undefined
at Object.injectIntoGlobalHook (react-refresh-runtime.development.js:465)
at<EMAIL_ADDRESS>(ReactRefreshEntry.js:8)
at webpack_require (bootstrap:851)
at fn (bootstrap:150)
at Object.1 (index.js:8)
at webpack_require (bootstrap:851)
at checkDeferredModules (bootstrap:45)
at Array.webpackJsonpCallback [as push] (bootstrap:32)
at main.chunk.js:1

I also met the same problem. What should I do?

me too. So, what should I do ?

close[React Developer Tools] It works! But can't developer tools be used

The developer tool version is too low, so you can download the new version of Google react developer tools.


Cannot pull from other registries when client is configured with private registry auth

Description
When creating a DefaultDockerClient instance with serverAddress, username, and password of a private registry, I am not able to pull images from other registries anymore (including docker.io).
Pushing and Pulling to the private registry works as expected.
I am not quite sure whether this is an issue of the docker client, docker or its configuration.
How to reproduce
final RegistryAuth auth = RegistryAuth.builder()
            .serverAddress( "https://url.to.private.registry" + "/v2/" )
            .username( "username" )
            .password( "password" )
            .build();

 final DefaultDockerClient dockerClient =
            DefaultDockerClient.builder()
            .uri( "http://" + "<IP_ADDRESS>" + ":" + "2375" )
            .registryAuth( auth )
            .build();

dockerClient.pull( "busybox:latest" );

What do you expect
The image busybox:latest will be pulled from docker.io on docker host <IP_ADDRESS>.
Note: This is working fine with an older docker version (1.7). With the docker version 1.12 it is not working anymore like described below.
What happened instead
The docker client crashes with a request error 401 Unauthorized when trying to pull the image from docker.io.
A DockerRequestException gets thrown:
Request error: POST http://<IP_ADDRESS>:2375/images/create?fromImage=busybox&tag=latest: 401
Software:

docker version:

Client:
 Version:      1.12.6
 API version:  1.24
 Go version:   go1.6.4
 Git commit:   78d1802
 Built:        Tue Jan 10 20:20:01 2017
 OS/Arch:      linux/amd64

Server:
 Version:      1.12.6
 API version:  1.24
 Go version:   go1.6.4
 Git commit:   78d1802
 Built:        Tue Jan 10 20:20:01 2017
 OS/Arch:      linux/amd64

Spotify's docker-client version:
Tested with version 7.0.2

Full backtrace
Exception in thread "main" com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST http://<IP_ADDRESS>:2375/images/create?fromImage=busybox&tag=latest: 401
	at com.spotify.docker.client.DefaultDockerClient.propagate(DefaultDockerClient.java:2103)
	at com.spotify.docker.client.DefaultDockerClient.request(DefaultDockerClient.java:2042)
	at com.spotify.docker.client.DefaultDockerClient.pull(DefaultDockerClient.java:1151)
	at com.spotify.docker.client.DefaultDockerClient.pull(DefaultDockerClient.java:1128)
	at com.spotify.docker.client.DefaultDockerClient.pull(DefaultDockerClient.java:1122)
	at dockerclienttest.Main.main(Main.java:67)
Caused by: javax.ws.rs.NotAuthorizedException: HTTP 401 Unauthorized
	at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:1002)
	at org.glassfish.jersey.client.JerseyInvocation.translate(JerseyInvocation.java:816)
	at org.glassfish.jersey.client.JerseyInvocation.access$700(JerseyInvocation.java:92)
	at org.glassfish.jersey.client.JerseyInvocation$5.completed(JerseyInvocation.java:773)
	at org.glassfish.jersey.client.ClientRuntime.processResponse(ClientRuntime.java:198)
	at org.glassfish.jersey.client.ClientRuntime.access$300(ClientRuntime.java:79)
	at org.glassfish.jersey.client.ClientRuntime$2.run(ClientRuntime.java:180)
	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
	at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
	at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
	at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:340)
	at org.glassfish.jersey.client.ClientRuntime$3.run(ClientRuntime.java:210)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

Hello.
Have you got a status on this issue?
I think I've the same problem…
The private registry which I use is a docker hub proxy. It could then pull the busybox image from the official docker hub without any problem. With the official go client, I have no problem. But with the java client, it does not work: I got a 401 Unauthorized error as describe by @triggetry (with the same stack trace).
Thanks in advance.

Hi unfortunately I was not (yet) able to find the root cause of this behavior.
My current workaround is to pass the RegistryAuth credentials on each and every pull. This works because this way I do not need to initialize the DockerClient with any credentials, hence I am also able to pull from public registries with no authentication. But I am not very happy with this workaround.
I also noted, that this issue is not reproduceable with the docker-java docker client.

A few questions:

What are the contents of your ~/.docker/config.json file?
How are you constructing the RegistryAuth / DockerClient object for the pulls from the public docker hub? Are you giving it no RegistryAuth information? (I mean when it fails, of course, but also when you’re doing your workaround.)

Personally, the code is deployed on a kubernetes cluster, so no particular ~/.docker/config.json.
For the construction of the RegistryAuth, we use the builder pattern:
RegistryAuth authConfig = RegistryAuth.builder()
    .email(email()).username(username()).password(password())
    .serverAddress(url())
    .build();

and the docker client is simply created with:
DefaultDockerClient.fromEnv().registryAuth(authConfig);

Just to remember, url is an URL to a docker proxy.
Hope it will help.

Up until version 8.6.0 docker-client was pretty naive about it's authentication support; it tried to use the same RegistryAuth instance for every single operation that needs authentication.
We've made several improvements related to this in 8.6.x and 8.7.0 that I think should improve the situation.
Please re-open or create a new issue if you think the new support (RegistryAuthSupplier) doesn't fix your problem.


Climatology function breaks with season == "ANN" and drivers silently ignores errors with fallback behavior

What happened?
I was writing a new climo() function in #677 and found a bug in the existing climo() function. The existing climo() function does not have a conditional statement for season == "ANN", causing this function to break if this case is true.
https://github.com/E3SM-Project/e3sm_diags/blob/4a82b0ec3b2a81233b294fa505c6aa8228ecbd27/e3sm_diags/driver/utils/climo.py#L47-L66
Downstream in the lat_lon_driver.run_diag() function, there is a section of code to get the land_frac and ocean_frac.
https://github.com/E3SM-Project/e3sm_diags/blob/4a82b0ec3b2a81233b294fa505c6aa8228ecbd27/e3sm_diags/driver/lat_lon_driver.py#L132-L142

If we run with "ANN", this section of code silently ignores this error due to except Exception (which captures all possible exceptions).
As a result, the exception will open the default mask file (acme_ne30_ocean_land_mask.nc) in all cases even if the masking variables exist in the test data and the climatology can be calculated for them.

What did you expect to happen?

climo() should support "ANN"
lat_lon_driver.run_diag() should only capture specific exceptions (e.g,. RunTimeError) and produce a logger warning if captured
Check all other drivers for similar cases as 2. and fix them

Minimal Complete Verifiable Example
Relevant log output
Anything else we need to know?
In PR #677 (work-in-progress), I wrote a new climo() function that resolves this issue:
https://github.com/E3SM-Project/e3sm_diags/pull/677/files#diff-682f63237e8473278ef0ba3c452382fd62c09bb5cd23a435c8397dfd1ae98487
Environment
Latest stable release and main branch

@chengzhuzhang @golaz @forsyth2 After another review, I found that there is no bug with climo() when testing on the main branch.
The climo() conditional does capture if season = "ANN"  using the last else statement. The season_idx dictionary has "ANN" defined.
https://github.com/E3SM-Project/e3sm_diags/blob/4a82b0ec3b2a81233b294fa505c6aa8228ecbd27/e3sm_diags/driver/utils/climo.py#L47-L66
https://github.com/E3SM-Project/e3sm_diags/blob/4a82b0ec3b2a81233b294fa505c6aa8228ecbd27/e3sm_diags/driver/utils/climo.py#L11-L29
There might actually be an issue in my branch of PR #670 that is throwing an exception which gets caught silently with the try except Exception statement. In any case, it is good practice to use a specific exception statement (E.g., except RunTimeError, which I will include in PR #670.
Closing this since issue.

@chengzhuzhang @golaz @forsyth2 After another review, I found that there is no bug with climo() when testing on the main branch.
The climo() conditional does capture if season = "ANN"  using the last else statement. The season_idx dictionary has "ANN" defined.
https://github.com/E3SM-Project/e3sm_diags/blob/4a82b0ec3b2a81233b294fa505c6aa8228ecbd27/e3sm_diags/driver/utils/climo.py#L47-L66
https://github.com/E3SM-Project/e3sm_diags/blob/4a82b0ec3b2a81233b294fa505c6aa8228ecbd27/e3sm_diags/driver/utils/climo.py#L11-L29
There might actually be an issue in my branch of PR #670 that is throwing an exception which gets caught silently with the try except Exception statement. In any case, it is good practice to use a specific exception statement (E.g., except RunTimeError), which I will include in PR #670.
Closing this issue.


Featuresupport insert into values for Nereids

Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.19 seconds
stream load tsv:          542 seconds loaded<PHONE_NUMBER>9 Bytes, about 131 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          66 seconds loaded<PHONE_NUMBER> Bytes, about 15 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.3 seconds inserted 10000000 Rows, about 341K ops/s
storage size:<PHONE_NUMBER>3 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.54 seconds
stream load tsv:          541 seconds loaded<PHONE_NUMBER>9 Bytes, about 131 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.7 seconds inserted 10000000 Rows, about 336K ops/s
storage size:<PHONE_NUMBER>3 Bytes

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.25 seconds
stream load tsv:          553 seconds loaded<PHONE_NUMBER>9 Bytes, about 129 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          30 seconds loaded 861443392 Bytes, about 27 MB/s
insert into select:          29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size:<PHONE_NUMBER>0 Bytes

run buildall

run p0

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.87 seconds
stream load tsv:          540 seconds loaded<PHONE_NUMBER>9 Bytes, about 132 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size:<PHONE_NUMBER>7 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.18 seconds
stream load tsv:          545 seconds loaded<PHONE_NUMBER>9 Bytes, about 130 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.4 seconds inserted 10000000 Rows, about 340K ops/s
storage size:<PHONE_NUMBER>3 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.66 seconds
stream load tsv:          537 seconds loaded<PHONE_NUMBER>9 Bytes, about 132 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size:<PHONE_NUMBER>2 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.44 seconds
stream load tsv:          545 seconds loaded<PHONE_NUMBER>9 Bytes, about 130 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size:<PHONE_NUMBER>8 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 50.27 seconds
stream load tsv:          546 seconds loaded<PHONE_NUMBER>9 Bytes, about 130 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.4 seconds inserted 10000000 Rows, about 340K ops/s
storage size:<PHONE_NUMBER>7 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.72 seconds
stream load tsv:          539 seconds loaded<PHONE_NUMBER>9 Bytes, about 132 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select:          28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size:<PHONE_NUMBER>6 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 51.06 seconds
stream load tsv:          546 seconds loaded<PHONE_NUMBER>9 Bytes, about 130 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.2 seconds inserted 10000000 Rows, about 342K ops/s
storage size:<PHONE_NUMBER>1 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.26 seconds
stream load tsv:          530 seconds loaded<PHONE_NUMBER>9 Bytes, about 134 MB/s
stream load json:         21 seconds loaded<PHONE_NUMBER> Bytes, about 107 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size:<PHONE_NUMBER>3 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.91 seconds
stream load tsv:          550 seconds loaded<PHONE_NUMBER>9 Bytes, about 129 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size:<PHONE_NUMBER>7 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 49.51 seconds
stream load tsv:          546 seconds loaded<PHONE_NUMBER>9 Bytes, about 130 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.3 seconds inserted 10000000 Rows, about 341K ops/s
storage size:<PHONE_NUMBER>0 Bytes

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.15 seconds
stream load tsv:          537 seconds loaded<PHONE_NUMBER>9 Bytes, about 132 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.2 seconds inserted 10000000 Rows, about 342K ops/s
storage size:<PHONE_NUMBER>0 Bytes

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run p0

run p0

run buildall

run buildall

run buildall

run buildall

remove dev/2.0.3 label since DDL is not enabled in 2.0


WIP

CHANGE DESCRIPTION
Problem:
Short explanation of the problem.
Cause:
Short explanation of the root cause of the issue if applicable.
Solution:
Short explanation of the solution we are providing with this PR.
CHECKLIST
Jira

[ ] Is the Jira ticket created and referenced properly?
[ ] Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
[ ] Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

[ ] Is an E2E test/test case added for the new feature/change?
[ ] Are unit tests added where appropriate?

Config/Logging/Testability

[ ] Are all needed new/changed options added to default YAML files?
[ ] Are the manifests (crd/bundle) regenerated if needed?
[ ] Did we add proper logging messages for operator actions?
[ ] Did we ensure compatibility with the previous version or cluster upgrade process?
[ ] Does the change support oldest and newest supported PG version?
[ ] Does the change support oldest and newest supported Kubernetes version?

Test name
Status

affinity
failed

We run 1 out of 16

commit: https://github.com/percona/percona-postgresql-operator/pull/580/commits/b7561ee3477247e360f4c9aa5e3b1904bcd59539
image: perconalab/percona-postgresql-operator:PR-580-b7561ee34-pgo-apiserver
image: perconalab/percona-postgresql-operator:PR-580-b7561ee34-pgo-event
image: perconalab/percona-postgresql-operator:PR-580-b7561ee34-pgo-rmdata
image: perconalab/percona-postgresql-operator:PR-580-b7561ee34-pgo-scheduler
image: perconalab/percona-postgresql-operator:PR-580-b7561ee34-postgres-operator
image: perconalab/percona-postgresql-operator:PR-580-b7561ee34-pgo-deployer

Test name
Status

affinity
failed

We run 1 out of 16

commit: https://github.com/percona/percona-postgresql-operator/pull/580/commits/7384aa005db667ba476455582c3b6b32e480d695
image: perconalab/percona-postgresql-operator:PR-580-7384aa005-pgo-apiserver
image: perconalab/percona-postgresql-operator:PR-580-7384aa005-pgo-event
image: perconalab/percona-postgresql-operator:PR-580-7384aa005-pgo-rmdata
image: perconalab/percona-postgresql-operator:PR-580-7384aa005-pgo-scheduler
image: perconalab/percona-postgresql-operator:PR-580-7384aa005-postgres-operator
image: perconalab/percona-postgresql-operator:PR-580-7384aa005-pgo-deployer

Test name
Status

affinity
passed

We run 1 out of 16

commit: https://github.com/percona/percona-postgresql-operator/pull/580/commits/176374e89773c80e4adead6f4f0ec8617cdcc474
image: perconalab/percona-postgresql-operator:PR-580-176374e89-pgo-apiserver
image: perconalab/percona-postgresql-operator:PR-580-176374e89-pgo-event
image: perconalab/percona-postgresql-operator:PR-580-176374e89-pgo-rmdata
image: perconalab/percona-postgresql-operator:PR-580-176374e89-pgo-scheduler
image: perconalab/percona-postgresql-operator:PR-580-176374e89-postgres-operator
image: perconalab/percona-postgresql-operator:PR-580-176374e89-pgo-deployer

Test name
Status

upgrade
failed

demand-backup
passed

init-deploy
failed

scheduled-backup
passed

version-service
passed

scaling
failed

recreate
failed

affinity
passed

smart-update
passed

monitoring
failed

self-healing
passed

operator-self-healing
passed

clone-cluster
passed

tls-check
passed

users
passed

ns-mode
passed

We run 16 out of 16

commit: https://github.com/percona/percona-postgresql-operator/pull/580/commits/d72f338d1ee37ce5eca747f226e76e17159b7337
image: perconalab/percona-postgresql-operator:PR-580-d72f338d1-pgo-apiserver
image: perconalab/percona-postgresql-operator:PR-580-d72f338d1-pgo-event
image: perconalab/percona-postgresql-operator:PR-580-d72f338d1-pgo-rmdata
image: perconalab/percona-postgresql-operator:PR-580-d72f338d1-pgo-scheduler
image: perconalab/percona-postgresql-operator:PR-580-d72f338d1-postgres-operator
image: perconalab/percona-postgresql-operator:PR-580-d72f338d1-pgo-deployer

Test name
Status

upgrade
passed

scheduled-backup
passed

init-deploy
passed

demand-backup
passed

version-service
passed

scaling
passed

recreate
passed

smart-update
passed

affinity
passed

monitoring
passed

self-healing
passed

operator-self-healing
passed

clone-cluster
passed

tls-check
passed

users
passed

ns-mode
passed

We run 16 out of 16

commit: https://github.com/percona/percona-postgresql-operator/pull/580/commits/8d50ca19575b846a96f287450b0f70df40726a65
image: perconalab/percona-postgresql-operator:PR-580-8d50ca195-pgo-apiserver
image: perconalab/percona-postgresql-operator:PR-580-8d50ca195-pgo-event
image: perconalab/percona-postgresql-operator:PR-580-8d50ca195-pgo-rmdata
image: perconalab/percona-postgresql-operator:PR-580-8d50ca195-pgo-scheduler
image: perconalab/percona-postgresql-operator:PR-580-8d50ca195-postgres-operator
image: perconalab/percona-postgresql-operator:PR-580-8d50ca195-pgo-deployer


Can not select .bin file

I would like to use iCloud to select .bin file, but I can not choose this type of file.
DocumentPicker.show({
                filetype: [DocumentPickerUtil.allFiles()],
            },(error,res) => {
                console.log(
                    res.uri,
                    res.type, // mime type
                    res.fileName,
                    res.fileSize
                );
            });

On iOS allFiles gives public.content. Looking at the UTI list .bin files are considered by Apple to be com.apple.macbinary-archive which doesn't inherit from public.content, instead it inherits from public.data and public.archive.
If you want all documents + .bin files, try this:

DocumentPicker.show({
  filetype: [DocumentPickerUtil.allFiles(), Platform.OS === 'ios' ? 'com.apple.macbinary-archive' : 'application/octet-stream'],
},(error,res) => {
  console.log(
    res.uri,
    res.type, // mime type
    res.fileName,
    res.fileSize
  );
});

Putting filetype: ['public.item'] worked for me.

closing as resolved


Remove the lock on apply_action

#90
#92

If accepted, I think this would deserve a beta release.

I test with the 1.5-alpha2. My covers reacts with several seconds delay to the click in the HA frontend.

How reactive is it when interacting through the TaHoma web dashboard?
Also, when clicking in the HA frontend, can you keep the Tahomalink website open and visible, you should get something like this:

Is the message on TaHoma dashboard appearing with the same delay?

It's very reactive at my place... Not sure why it would add any delay.

There is no delay through the TaHoma Dashobard. I can change the position, wait a little bit and click on stop and the cover reacts immediately.
Through HA it starts in general directly but not always. When there is a delay then you see the delay also on the TaHoma dashboard.
One interesting point: The stop button is not working while moving. When I click the button on TaHoma dashboard it stops immediately. (Please wait some seconds after you start the movement and then try to click on stop - for me it is not working)

"When there is a delay then you see the delay also on the TaHoma dashboard."
Do you mean there is the delay for the message in my screen capture to appear?
If so, the delay is in the communication between HA and TaHoma, not between TaHoma and the Cover.
Be aware that the api is an unofficial one, not intended by Somfy to be used by HA. Hence sending lots of requests in a row might get you kicked out, forcing a re-log that might take few seconds.
I don't know about the stop button, but I suspect it's not related to the delay, so I propose to keep it aside for now.

The delay is completely new to me. Before I had to use the current version (because of the login issue) there were no such delays. It appears the first timt 30 minutes ago after the HA update to 0.112 and the component update to 1.5-alpha2

The delay might be related to the login issue. I probably still get logged out, then the api re-logs you in automatically causing the delay. We would need to figure out why you get logged out, but I have no idea how to do that...

Overhere it is far beter then in the last versions. Before the stop button wasn't reacting, and now it is. will test again in few hours.
0.112 en alpha2

The delay might be related to the login issue. You probably still get logged out a lot, then the api re-logs you in automatically causing the delay. We would need to figure out why you get logged out, but I have no idea how to do that...
Ok, that could be the reason for the delay. It would be great to get this fixed - but I also have no idea, how to find the reason

Overhere it is far beter then in the last versions. Before the stop button wasn't reacting, and now it is. will test again in few hours.
Interesting ... for me all versions including 1.3 were much better than the current version and the stop button was working for me without problems. The problems for me start with version 1.4 (which I skipped until the login issue)

Can you open a new issue with details on your cover regarding the stop button?
I'll try to put more log messages to find why you get kicked out of the api.

I tested it again and I would say that the reason is the login issue. I clicked on the move-down-button and it had a delay of around 2 seconds. The same happens when I clicked on the stop-button some seconds later. So I would say it relates not only to the stop-button.

can you edit the file tahoma_api.py and add the following line 157, just before the if not self.login()
_LOGGER.debug("not authenticated: login again.")

Restart HA a try again with debug log setup for the component (see here)

By the way, conversation should be moved to #86


Mobile Bug: Touch events no longer detected on iPhone if game pauses or hits breakpoint during pointerdown event

On ios devices, 'pointerdown' events created using this.input.on('pointerdown', myFunc, this) or image.on('pointerdown', myFunc, this) will no longer fire if the game pauses during the execution of its callback function. This can happen if a debugger statement or breakpoint is placed inside the myFunc callback function. It can also happen to users if the drag down menu (http://ift.tt/1n2dgPw) is pressed while simultaneously pressing inside the game. The second case may take a few tries to reproduce but here is a video of me reproducing the bug: https://youtu.be/aCICmilOrz8
Reproduced on iPhone 6S+ (10.3.2), iPhone 6 Plus (11.1), and iPad Air 4G (10.3.2)
This issue does not occur on Android devices or any PCs (tested on Mac Safari and Windows Chrome)
Sample code that can trigger the bug:
var config = {
    width: 800,
    height: 600,
    backgroundColor: '#2d2d2d',
    parent: 'phaser-example',
    scene: {
        preload: preload,
        create: create
    }
};

var game = new Phaser.Game(config);

function preload ()
{
    this.load.image('button', 'button.png');
}

var image1;
function create ()
{
    var self = this
    window.addEventListener('touchstart', function(evt) {
        // this can still trigger even after the bug has occurred
        console.log("touch start");
    });
    image1 = this.add.image(400, 200, 'button');
    this.input.on('pointerdown', one, this);
    this.input.on('pointerup', two, this);
}

function one() {
    // This function no longer gets called after the bug has occurred
    console.log("button press");
    // this debugger statement can trigger the bug. Even without it, bug can happen by pressing the drop down menu
    debugger;
    image1.alpha = 0.2;
}
function two() {
    image1.alpha = 1;
}

HTML:
<!doctype html>
<html lang="en">
<head>
    <meta charset="UTF-8" />
    <title>Lottso Express</title>
    <script src="phaser.min.js"></script>
    <script src="main.js"></script>
    <style type="text/css">
        body {
		background-color: grey;
        }
	canvas {
		display:block;
		margin: 0;
		position: absolute;
		top: 50%;
		left: 50%;
		transform: translate(-50%, -50%);
	}
	#phaser-app {
		margin: 0 auto;
	}
    </style>
</head>
<body>
</body>
</html>

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

I've figured out a work-around for this bug, though it will likely break multi-touch. In phaser.js at function stopPointer, change the pointer.identifier === changedTouch.identifier check to pointer.identifier <= changedTouch.identifier:
stopPointer: function (event, time)
{
    var pointers = this.pointers;

    for (var c = 0; c < event.changedTouches.length; c++)
    {
        var changedTouch = event.changedTouches[c];

        for (var i = 1; i < this.pointersTotal; i++)
        {
            var pointer = pointers[i];
            if (pointer.active && pointer.identifier === changedTouch.identifier)
            {
                pointer.touchend(changedTouch, time);
                break;
            }
        }
    }
},

to:
stopPointer: function (event, time)
{
    var pointers = this.pointers;

    for (var c = 0; c < event.changedTouches.length; c++)
    {
        var changedTouch = event.changedTouches[c];

        for (var i = 1; i < this.pointersTotal; i++)
        {
            var pointer = pointers[i];
            // Change === to <= here
            if (pointer.active && pointer.identifier <= changedTouch.identifier)
            {
                pointer.touchend(changedTouch, time);
                break;
            }
        }
    }
},

The game freeze happens because changedTouch.identifier becomes de-synced from pointer.identifier, which causes the current touch event to no longer terminate so new touch events cannot happen. I suspect that Safari might be cleaning up the most recent touch event when you open the drag down menu, which causes the de-sync when you also happen to touch something in a Phaser game at the exact same moment.

Thanks a lot for filing this and the detailed explanations @maximtsai .
As a workaround I tried to remove the input listener when the game loses focus and add it back when it returns. For me the problem is particularly with using Facebook instant platform's function which opens a modal dialog which causes my game to lose control.
This is what I tried:
function create() {
  // listen to mouse clicks at the start
  this.input.on('pointerdown', function() {
    // some code
  });
}
var doneChoosing = false;

// Invite friends - this makes the game lose focus
// When this is called, the problem starts
function inviteFriends(that) {
  // Remove listener so that the handler code doesn't get triggered
  that.input.removeListener('pointerdown');
  FBInstant.chooseAsync().then(function() {
    doneChoosing = true;
  }).catch(function() {
    doneChoosing = true;
  });
}

function update() {
  if (doneChoosing) {
    // control is back to the game and the dialog has been opened and closed
    // add back input listener
    this.input.on('pointerdown', function() {
      // some code
    });
  }
}

However this doesn't solve the problem. Any idea why?

Hi @photonstorm do you think the workaround suggested by @maximtsai would be safe to use as long as I don't use multi touch in my game? Or do you know of any other workarounds to use until this bug is fixed?
Thanks!

I've been looking at this all morning and I'm struggling to replicate it using Phaser 3.13 Beta 1. I added a call to debugger in my pointerdown callback and Safari on iPad (iOS 11) still keeps on triggering the event just fine.
I've pulled the drop-down menu down many, many times, tapping while doing so, letting go quickly, letting go slowly, etc.
I've even tried multi-tasking in iOS with another app docked alongside Safari, then pulling the drop-down and it still works.
Is there some other trick to doing this?! Or has it just been inadvertently fixed in a recent Phaser update without realizing it?

@photonstorm I used to be able to consistently reproduce it with FBInstant's APIs. If I can get my hands on 3.13 beta 1 I would be able to tell you if I can still reproduce it.

You can find 3.13 in the master branch, or if you need a pre-built file use this:
phaser.js.zip

@photonstorm I think the issue is not present anymore, however, the game runs at a very low FPS (like 6 fps on an iPhone) after bumping up Phaser. If I just replace phaser.min.js with the older version with no other change the game becomes fast again.

Just to say that I've uploaded 3.15 Beta 1, which I'm hopeful resolves this bug fully. You can find it in the master branch, or if you need a pre-built file grab it from my comment in #3756


RTX2070 8GB Results

If some of you want to compare, that's what I get with mine.
I tried a lot of settings and so far that is the best that I can get.
Zotac RTX 2070 8GB
GPU CLOCK: 1800 MHz (+144 MHz)
MEM CLOCK: 6866 MHz (+66 MHz)
CudaInfo.exe
ID: 0
Name: GeForce RTX 2070
Capability: 7.5
MP: 36
Cores: 2304 (64 per MP)
Memory: 8192MB
MAX Mkey/s : ~805
AVG Mkey/s : ~795
Settings:
cuBitCrack.exe -b 36 -t 512 -p 2986 => 200 Targets
I can't go higher than 2986 unless I getting down some threads or core
[2019-01-12.18:21:17] [Info] Compression: compressed
[2019-01-12.18:21:17] [Info] Starting at:<PHONE_NUMBER>000000000000000000000000000000000000000000000000000001
[2019-01-12.18:21:17] [Info] Initializing
[2019-01-12.18:21:17] [Info] Generating 55,037,952 starting points (2099.5MB)
GeForce RTX 2070 6511/8192MB | 200 targets 806.55 MKey/s (6,362,222,137,344 total) [02:15:29]

on my r9 290 i so no diff between 1 (just 1) or 8 000 000 keys....


Add test for upgrading from previous release

It would be nice to have our tests check for us how a change is going to affect upgrading from a previous release.
This PR adds a test that creates a prototype from the previous release code, then runs the update script to check whether the update succeeds or not.
At the moment we don't do any other particular checks, but I guess we could add some as we think of them.

the "testFailingIf" function in "utils.test.js" is passing in the CI and is therefore either unnecessary or there is an unexpected bug?

the "testFailingIf" function in "utils.test.js" is passing in the CI and is therefore either unnecessary or there is an unexpected bug?

Forgot I'd put those there. Removed now, tests should pass everywhere.

I've got it working on macOS and Linux, but it's still getting stuck on Windows, and I don't know why 😞

I've decided to skip the hanging test for now (on Windows only), so we can move forwards. I'll create a tech debt ticket to address the issues after this has been approved and merged.


Hotkey Customization

Hey aelij,
Is there any way to customize the existing keyboard shortcuts for your application? Thanks!
-Evan

Not currently

Hello @aelij,
Is there a shortcut to open the CodeFixes menu?

Ctrl+.  just like VS :)

Thanks! I didn't know about this shortcut for me it is enough to use ReSharper Ctrl+Space and Alt+Enter for most things  :)