perf(common_ground_filter): performance tuning

Description
This PR makes scan_ground_filter(as common_ground_filter) faster without changing the logical output.
The tail latency of the scan_ground_filter gets about x1.7 faster with this PR merged.

The main changes are as follows.

Minimized the use of trigonometric functions such as std::atan2.
Processed the input point cloud without converting it to pcl::PointCloud.

In addition, some small changes are made to improve performance.
Measurement Condition
・Ubuntu22.04 + ROS2 Humble + Autoware Universe rosbag simulation
・Core Isolated
・Core Frequency Fixed (2.3GHz)
・L3 Cache: 24MB
Related links
Implementation details, performance analysis of previous implementation(TIER IV internal link): https://tier4.atlassian.net/wiki/spaces/~6422e65c57f0c028e2f72804/pages/2890237067/
Detailed explanation of this change(TIER IV internal link): https://tier4.atlassian.net/wiki/spaces/~6422e65c57f0c028e2f72804/pages/2945910575/
Tests performed
Checked if scan_ground_filter_node publishes the same logical output as before (using Autoware Universe rosbag simulation).
To reproduce(TIER IV internal link): https://drive.google.com/drive/folders/1_EGq1YHQl9yxYtOb6tjhvrmXUuY6qbsw
Run python3 validator.py default.csv after.csv for comparing results.
Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[x] I've confirmed the contribution guidelines.
[x] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.
[ ] The PR has been properly tested.
[ ] The PR has been reviewed by the code owners.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.
[ ] The PR is ready for merge.

After all checkboxes are checked, anyone who has write access can merge the PR.

@taisa1
The unit test is failed due to changes in filter(). It is recommended that the unit tests also use faster_filter().
https://github.com/autowarefoundation/autoware.universe/actions/runs/7342510285/job/19991834839?pr=5861

This is the result of TIER IV CI test. https://evaluation.tier4.jp/evaluation/reports/f87c3c5b-89b0-5904-acb8-afae5ff2fdfc?project_id=prd_jt

After running our CI tests, we've observed a significant increase in the number of failure. The number of passing test cases, dropping from 148 to 68. While we haven't confirmed the details yet, it seems that some errors may be occurring.

Thanks!
I can see some changes, but there are still many failures.
https://evaluation.tier4.jp/evaluation/reports/d9fcb22f-095a-5b13-89a2-82b72be71201?project_id=prd_jt

@miursh
Sorry for the late response. :bow:
I found a variable uninitialized and have fixed it, could you review this again?

@badai-nguyen
Thank you for the other day.
I used the tutorial to observe the state of the point cloud before and after PR and found no particular difference, as shown in the images below. (Used autoware.universe commit ID: ebb4172992ef0a3d989a57af227d2545d404b63c)
It seems to be working correctly in my environment, could you please review again?

Before
After


It is very difficult to set up a boom-bust style analysis that only uses sequence data

It is very difficult to set up a boom-bust style analysis that only uses sequence data because the most appropraite parameterisation is missing a fxtemplate file
https://github.com/aezarebski/timtam2/blob/6da605bd6e2ae430575286092c594d54d9327ea6/src/timtam/TimTam.java#L163
A nice solution would be to put together a "sequence only" fxtemplate for the cases where people do not want to worry about the time series. There is also some fiddling around with change times in this setting that would be a pretty big barrier to usage of the model.

This has been merged into dev-v2.7 and a couple of example XML files have been included to demonstrate the results


incorrect order/display when refreshing page immediately after build

If a build the project, then refresh the page, the currently building item is listed in the incorrect order.
I'm not sure exactly what is causing this, but I'll attach a screenshot for reference. I think this may have started occurring when I killed the concrete server prematurely while a build was in process.

Strange, having some trouble recreating this. Let me know if there are any other details you can give surrounding the bug.


Shapes won't visualize

Description of the bug
When I'm visualizing a graph, with multiple geographical shapes, it only displays one specific shape and not the other ones. I already checked the quality of my cube design, I guess it is fine.
To Reproduce
Steps to reproduce the behaviour:
Link to the Cube (int): Link
Link to the Visualization (int): Link

I want to visualize my above linked cube. So I click on the according button on the Cube Creator Tool to get to the above-mentioned Visualize visualization.

At Visualize, I click on the "Start a visualization" button.

I continue with clicking on the Map icon, since I want to display the shapes with the according value.

It shortly loads and displays only one specific shape (the one of Biel/Bienne). Even if I filter it is not possible to either display another map shape, or all the shapes ant once.

According to the SparQL-request  the shapes of are correctly linked.

Expected behavior
Either all the map shapes should be visualized together and/or all the shapes can be filtered and visualized alone.
Environment:

Visualize environment and version: INT 4.0.0
Browser and version: Microsoft Edge Version 122.0.2365.92

Additional context
Maybe this issue corresponds to the bug #1430 I just added.

Tested on INT v4.1.0 https://int.visualize.admin.ch/en/v/Cvd0ayxHH4Vd?dataSource=Int all the map shapes should be visualized together as expected


Roll Flutter Engine from 38d950a44245 to 10ff30257d76 (5 revisions)

https://github.com/flutter/engine/compare/38d950a44245...10ff30257d76
2022-06-08<EMAIL_ADDRESS>[android] set presentation time via eglPresentationTimeANDROID (flutter/engine#33881)
2022-06-08<EMAIL_ADDRESS>[web] Avoid returning List from DOM apis. (flutter/engine#33880)
2022-06-08<EMAIL_ADDRESS>Roll Skia from c3d83ab18efa to 9245ecb239a2 (3 revisions) (flutter/engine#33903)
2022-06-08<EMAIL_ADDRESS>Roll Dart SDK from 6a7e6decee92 to 68fd70178cbf (1 revision) (flutter/engine#33902)
2022-06-08<EMAIL_ADDRESS>Added plist flag for enabling trace-systrace. (flutter/engine#33889)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


Ultimate.py error when invoking bot.like_timeline

Please follow the guide below

Issues submitted without this template format will be ignored.
You will be asked some questions and requested to provide some information, please read them carefully and answer completely.
Put an x into all the boxes [ ] relevant to your issue (like so [x]).
Use the Preview tab to see how your issue will actually look like.

Before submitting an issue, make sure you have:

[x] Updated to the latest version
[x] Read the README and docs
[x] Searched the bugtracker for similar issues including closed ones

Purpose of your issue?

[x] Bug report (encountered problems/errors)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections requests more details for particular types of issues, you can remove any section (the contents between the triple ---) not applicable to your issue.

For a bug report, you must include the Python version used, code that will reproduce the error, and the error log/traceback.
Paste the output of python -V here: 3.6
Code:
def like_timeline():
    bot.logger.info("like_timeline")
    bot.like_timeline(amount=300 // 24)

Error/Debug Log:
2018-08-13 15:30:10,494 - INFO - Liking timeline feed:
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/local/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "conf/ultimate.py", line 51, in like_timeline
    bot.like_timeline(amount=300 // 24)
  File "/opt/app/conf/../instabot/bot/bot.py", line 407, in like_timeline
    return like_timeline(self, amount)
  File "/opt/app/conf/../instabot/bot/bot_like.py", line 59, in like_timeline
    medias = self.get_timeline_medias()[:amount]
  File "/opt/app/conf/../instabot/bot/bot.py", line 300, in get_timeline_medias
    return get_timeline_medias(self)
  File "/opt/app/conf/../instabot/bot/bot_get.py", line 46, in get_timeline_medias
    return self.filter_medias(self.api.last_json["items"], filtration)
KeyError: 'items'

Describe your issue
Not sure if I am doing something wrong :) but I suppose no, since there not need for any configuration for this API call

looking at the code is suspect that 'feed_items' is correct rather than 'items'

Having the same issue, the answer of @chicco785  is correct , though i can't edit the source code because is placed in an .egg file . Any ideas how to fix it ?

still doesnt work @chicco785

Has anyone managed to fix this?
I have changed items to feed_items in bot_get.py (line 46, function get_timeline_medias). The error is gone but the bot always shows "After filtration 0 medias left. Nothing to like.". In fact, there are many medias that have not been liked when I open my timeline

no one has managed to fix this and its very disappointing @putuariepra


how do you get the access_token?

I'm writing  a custom provider, and looking at how to get access to the access_token in the callback respones. It looks buried in serverless-authentication which seems to return a profile, but no access_token. But maybe I'm missing something?

Yes, the authentication flow is buried to the provider class https://github.com/laardee/serverless-authentication/blob/master/src/provider.js. How are you planning to use the access_token later on?

I was planning on making subsequent api calls once the initial flow has been started. I'd use the auth'd api from within the lambda function/app later on. Which would require access to the token.

I don't see a reason why it couldn't be returned along with the profile. I added it to provider class and it will be available in _raw (profile._raw.access_token). I'll do some other improvements before I publish this to npm, but i'll try to do that as soon as possible.

thanks!

In serverless-authentication v.0.4.4 (in npm) access_token is mapped as profile.at_hash as defined in OpenId standard (instead of profile._raw.access_token). I decide to use that because I've started to implement some Cognito features (#8 and #9) which uses OpenId fields.

Heyy i tried to install the project but it is giving me error.I tried to figure it out but no clue.
Can you help me with this??
npm ERR! Linux 3.19.0-58-generic
npm ERR! argv "/home/nishtha/.nvm/versions/node/v4.3.2/bin/node" "/home/nishtha/.nvm/versions/node/v4.3.2/bin/npm" "install"
npm ERR! node v4.3.2
npm ERR! npm  v2.14.12
npm ERR! path /home/nishtha/.npm/lodash/4.13.0
npm ERR! code EACCES
npm ERR! errno -13
npm ERR! syscall mkdir
npm ERR! Error: EACCES: permission denied, mkdir '/home/nishtha/.npm/lodash/4.13.0'
npm ERR!     at Error (native)
npm ERR!  { [Error: EACCES: permission denied, mkdir '/home/nishtha/.npm/lodash/4.13.0']
npm ERR!   errno: -13,
npm ERR!   code: 'EACCES',
npm ERR!   syscall: 'mkdir',
npm ERR!   path: '/home/nishtha/.npm/lodash/4.13.0',
npm ERR!   parent: 'async' }
npm ERR!
npm ERR! Please try running this command again as root/Administrator.
npm ERR! Please include the following file with any support request:
npm ERR!     /tmp/__sls_project_install_serverless-authentication-boilerplate_1463997196535/node_modules/serverless-authentication-boilerplate/authentication/npm-debug.log
npm ERR! Linux 3.19.0-58-generic
npm ERR! argv "/home/nishtha/.nvm/versions/node/v4.3.2/bin/node" "/home/nishtha/.nvm/versions/node/v4.3.2/bin/npm" "install" "serverless-authentication-boilerplate"
npm ERR! node v4.3.2
npm ERR! npm  v2.14.12
npm ERR! code ELIFECYCLE
npm ERR<EMAIL_ADDRESS>install: cd authentication && npm install && cd ../authorization && npm install
npm ERR! Exit status 243
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script 'cd authentication && npm install && cd ../authorization && npm install'.
npm ERR! This is most likely a problem with the serverless-authentication-boilerplate package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     cd authentication && npm install && cd ../authorization && npm install
npm ERR! You can get their info via:
npm ERR!     npm owner ls serverless-authentication-boilerplate
npm ERR! There is likely additional logging output above.
npm ERR! Please include the following file with any support request:
npm ERR!     /tmp/__sls_project_install_serverless-authentication-boilerplate_1463997196535/npm-debug.log
]
killed: false,
code: 1,
signal: null,
cmd: '/bin/sh -c npm install serverless-authentication-boilerplate' },
isOperational: true,
killed: false,
code: 1,
signal: null,
cmd: '/bin/sh -c npm install serverless-authentication-boilerplate' }

@nishtha3006 you could create a new issue about this, but I guess the problem could be the npm install script. You could remove
"install": "cd authentication && npm install && cd ../authorization && npm install",

from package json. Then run npm install (maybe with sudo in your case?) in project root, authentication and authorization folders.


All data is created for contradictory profiles when violating

Bug Report
Steps to Reproduce:

Generate violating data for the profile given below (tested with interesting)

{
  "schemaVersion": "v3",
  "fields": [{ "name": "foo" }],
  "rules": [
    {
      "rule": "firstRule",
      "constraints": [
		{
			"not": { "field": "foo", "is": "null" }
		}
      ]
    },
	{
      "rule": "secondRule",
      "constraints": [
		{
			"not": { "field": "foo", "is": "null" }
		}
      ]
    }
  ]
}

Expected Result:
No data generated in either output file
Actual Result:
Both output files contain all possible values for the field foo.

exhaustive combination of values for each field.
There is only one field? So this produces an exhaustive list for foo?

exhaustive combination of values for each field.
There is only one field? So this produces an exhaustive list for foo?

Comment updated.

wait... so we produce data with only one rule violated per file? So we never produce a file with fully violating data?!

If this was tested with Interesting is this an interesting-related bug instead (de-scoped for current milestone). What is the behaviour with a different generation?

If this was tested with Interesting is this an interesting-related bug instead (de-scoped for current milestone). What is the behaviour with a different generation?

It was tested with interesting, but it will be an issue for any generation type for the reductive walker


Easily see version without needing to go to command line

Thanks for the PR! This info is available today by right-clicking on the Ollama macOS app and choosing "Get Info":


Automatic discovery of MQTT credentials

Hello,
I see that this addon:
https://github.com/mdegat01/addon-amr2mqtt/tree/main/amr2mqtt
Doesn't need to enter broker host and MQTT credentials. Do you think we could leverage the same principle per default?
And only use the host and credentials if they are set by the user.

Good find. I doubt I'll have time to start working on it before mid-December though.

I suspect that we are only missing this:
https://github.com/mdegat01/addon-amr2mqtt/blob/8fdd816e98d74afd53aa2b958e38d86063c0af94/amr2mqtt/config.yaml#L18
Thoughts?

I would say that - mqtt:want is not related, based on the documentation.
But try it if you want. I'm not an authority on the matter. 😁

I confirm that  - mqtt:want is not related.

Just found that the RTL_433 addon doesn't need MQTT credentials also https://github.com/pbkhrv/rtl_433-hass-addons/blob/main/rtl_433/config.json

Added in https://github.com/mihsu81/addon-theengsgw/releases/tag/v1.11.4.
Thanks for the hints.


Error:  cannot import name '_ext'

hi,
Thank you for your v2 TernausNet, I appreciate your paper on arXiv and I follow your several papers and like the clear logic and intuition.
When I run this code in Demo file, I face an error
ImportError: cannot import name '_ext'
during running this command:
from models.ternausnet2 import TernausNetV2
I check it and find it results from this line:
from . import _ext
from modules\functions.py
I google it and cannot figure how from . import _ext works at all.
Could you please give me some hint to solve this issue?
Thank you very much!
Best,
Xiao

Thank you very much!
The following tips may help:
For non-sudo user, when run
./build.sh
command, it may face no nvcc error:
run the following command in linux may help:
export PATH=${PATH}:/usr/local/cuda/bin
For people who face g++ compiling error, installed g++ 6.4 and updates the symbolic links in /usr/bin will help.
thank you very much

Where is build.sh file please?

Where is build.sh file please?
Have you  find the build.sh file? I can't find the module folder。

Where is build.sh file please?

Where is build.sh file please?
Have you  find the build.sh file? I can't find the module folder。

@cutecy  @HuaqiangWei
I check the history and it's deleted by the author. Maybe the new version don't need it anymore.


cleanup of code supporting compliance

removed addon concept
added description to saved search
misc test cleanup
see also: Solinea/goldstone-compliance#59

Current coverage is 69.15%

Merging #378 into master will decrease coverage by -0.85% as of 88e6c21

@@            master    #378   diff @@
======================================
  Files           69      64     -5
  Stmts         2667    2597    -70
  Branches         0       0
  Methods          0       0
======================================
- Hit           1867    1796    -71
  Partial          0       0
- Missed         800     801     +1

Review entire Coverage Diff as of 88e6c21

Uncovered Suggestions

+0.66% via goldstone/views.py#30...46
+0.62% via ...stone/drfes/views.py#134...149
+0.43% via ...tone/drfes/models.py#165...175
See 7 more...

Powered by Codecov. Updated on successful CI builds.


[Question] So this is simply helping me remove a couple lines of code by installing a package and running a command?

So this is simply helping me remove a couple lines of code by installing a package and running a command?

In medium to large apps, like the one I'm working on now, it allows me to get rid of 100s of lines of redundant and repetitive code. And that's another thing less to worry about too as the morph map is something you need to maintain if your app structure changes. It also provides a uniform way of mapping the polymorphic types so there are no discrepancies.
You can just install the package and it automatically maps all your models. The cache command is optional but advised in production environments to speed it up a bit. Package itself is optional too ;)

Laravel auto morph map improves upon that by scanning all your Eloquent models, automatically aliasing them as uniform singular table names, and registering them as a polymorphic type. No more need for dozens of manual Relation::morphMap() calls to register model morph types!

Isn't the intro in the readme kind of the same? :p What would you add or change to make it more clear? Always love to hear feedback!


ISSUE: automation issue

Describe the bug
After amazon email is received in the watched folder, M&P will rereport a package as arrived even though it is a previous email that has already been checked .
Environment (please complete the following information):

OS: HassOS
Type of device: Unraid VM
Home Assistant version: 2023.1.4
Hassio
Component version: 0.3.5-b16

Logs
Paste your error logs here.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
I have an automation that when a package has been delivered, it increases a counter from "0" to "1". This triggers another automation to let us know when coming home, that a package is on the porch. We then tell Alexa that "we got the package off the porch" and she runs a routine that resets the counter back to zero. This has been working great until a couple weeks ago. Now, for some reason, when the email box receives the email notification that a package has been delivered, it is not flagging it as read or what ever it does, so after a while, it will say another package has been delivered, even though there is not a new email for a delivery.

Counters don't reset until midnight.


Rename riscv in pipelines to riscv64

This should really have been riscv64 from the start as that's what uname -m is on the boxes, and it's a 64-bit build. Hopefully these are the only places it needs to be changed :-)
Signed-off-by: Stewart Addison<EMAIL_ADDRESS>

This PR is fine but the changes might not be brought into the pipelines until https://github.com/AdoptOpenJDK/openjdk-build/pull/1792#issuecomment-636004346 is resolved


[GITHUB-9] Add support for password

If for some reason you can't use SSH keys and you're forced to use
passwords, you can now specify a password hash for a user.
Simply run mkpasswd --method=SHA-512 to get the password hash.

Always use ssh keys - avoid passwords at all cost.


My compiled AQ.exe's size is 3,776KB or 69,918KB. What's the problem?

I have compiled an AQ.exe file with Release and x64 option in visual studio 2015(windows 7 64bit).
But a compiled AQ.exe's size is very smaller than a released AQ.exe's size(263,483KB) and naturally failed to execute.
Help me~

Maybe I'll be able to solve it.
I guess that I didn't build tensorflow_gpu lib with cuda & cudnn.


[Bug] TypeError: () got multiple values for keyword argument 'allow_pickle'

Describe the bug
A clear and concise description of what the bug is.
In 0_demo.ipynb, the cell that performs the prediction would fail in SageMaker Studio with SageMaker JumpStart PyTorch 1.0 kernel with the following error message:
%%time
# SageMaker 1.x doesn't allow_pickle=True by default
np_load_old = np.load
np.load = lambda *args, **kwargs: np_load_old(*args, allow_pickle=True, **kwargs)
demo_predictions = demo_detector.predict(input)
np.load = np_load_old
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<timed exec> in <module>

/opt/conda/envs/sagemaker-soln/lib/python3.7/site-packages/sagemaker/predictor.py in predict(self, data, initial_args, target_model, target_variant)
    121         request_args = self._create_request_args(data, initial_args, target_model, target_variant)
    122         response = self.sagemaker_session.sagemaker_runtime_client.invoke_endpoint(**request_args)
--> 123         return self._handle_response(response)
    124
    125     def _handle_response(self, response):

/opt/conda/envs/sagemaker-soln/lib/python3.7/site-packages/sagemaker/predictor.py in _handle_response(self, response)
    130         response_body = response["Body"]
    131         content_type = response.get("ContentType", "application/octet-stream")
--> 132         return self.deserializer.deserialize(response_body, content_type)
    133
    134     def _create_request_args(self, data, initial_args=None, target_model=None, target_variant=None):

/opt/conda/envs/sagemaker-soln/lib/python3.7/site-packages/sagemaker/deserializers.py in deserialize(self, stream, content_type)
    223                 return np.array(json.load(codecs.getreader("utf-8")(stream)), dtype=self.dtype)
    224             if content_type == "application/x-npy":
--> 225                 return np.load(io.BytesIO(stream.read()), allow_pickle=self.allow_pickle)
    226         finally:
    227             stream.close()

<timed exec> in <lambda>(*args, **kwargs)

TypeError: <lambda>() got multiple values for keyword argument 'allow_pickle'

To Reproduce
Steps to reproduce the behavior and error details
In SageMaker Studio, open JumpStart solution browser, launch a Product Defect Detection in Images solution, use SageMaker JumpStart PyTorch 1.0 kernel, execute all cells in the 0_demo.ipynb notebook.
Expected behavior
A clear and concise description of what you expected to happen.
The cell should execute, and return values to demo_predictions variable.
Additional context
Add any other context about the problem here.
The sagemaker python sdk version: 2.18.0.

Reran the whole thing with np.load redefinition part commented out. It worked.
%%time
# SageMaker 1.x doesn't allow_pickle=True by default
# np_load_old = np.load
# np.load = lambda *args, **kwargs: np_load_old(*args, allow_pickle=True, **kwargs)
demo_predictions = demo_detector.predict(input)
# np.load = np_load_old

CPU times: user 16.6 ms, sys: 6.34 ms, total: 22.9 ms
Wall time: 1.52 s

Thanks! we'll issue a fix. Note that this GitHub is for reference-only and we don't take any PRs.


Microsoft Bot Framework Queries

Bot Info

Active Channels: MS Teams

Issue Description

What is the max / ideal message size of the message Microsoft bot connector sends to the chat bot ?
What is the maximum number of connections Microsoft Bot Framework allows ?
What is the maximum number of messages (message per minute / sec) that is permitted by Microsoft Bot Framework ?
How does app-id behave when a bot / resource is deployed for multiple data centers ? (Is app id specific to the data center?)

What is the max / ideal message size of the message Microsoft bot connector sends to the chat bot?
There is no set limit within the bot framework itself, however as you've mentioned this is dependent on the channel connector itself. In your case, with respect to Microsoft teams the documentation on message length can be found here
What is the maximum number of connections Microsoft Bot Framework allows ?
Aside from the throttling mentioned in the answer to the next question, there is no set or official connection limit currently. Discussion on this can also be found here
I'd like to note that the free tier allows for 10k messages a month, with the bot shutting down after that, however there is not a concurrent connection limit set on how these are used.
What is the maximum number of messages (message per minute / sec) that is permitted by Microsoft Bot Framework ?
Taken from this documentation
"The Bot Framework does not impose any restrictions on the number of messages that a bot may send. However, most channels enforce throttling limits to restrict bots from sending a large number of messages in a short period of time. Additionally, if the bot sends multiple messages in quick succession, the channel may not always render the messages in the proper sequence."
With respect to rate limiting in MS teams in particular, this is in flux so the reccomendation is to follow the documentation here
How does app-id behave when a bot / resource is deployed for multiple data centers ? (Is app id specific to the data center?)
The appID is specific to your bot, however your bot is tied to a specific data center on creation. Effectively the answer to this is yes, each instance of your bot will have an appID and if you choose to create multiple instances with different data centers each of those will have a different appID.

Hi Team,
For the last question, i understand that the appID is tied to the Microsoft DC where the resource was created. If there is a requirement to keep the appID constant for a particular region / globally, will that be possible in any way ?

Regionally is possible, but globally is not unless you route all requests to the same bot instance. However this might result in a slower experience the further out the instance is from your customers.


Reduce amount of roundtrips when setting tags

Currently https://github.com/balena-io/balena-sdk-python/blob/v12.5.0/balena/models/tag.py#L58-L65 requires several roundtrips to set a tag, which is discrepant from nodejs SDK where we can directly use the device UUID to set the tag.

Follows upsert pattern as node-sdk #296


How to deselect / reset selected date after select start-date & end-date

Description
i want to deselect /reset end-date when i click on selected date (start-date & end-date) after i choose start-date & end-date.
Expected behavior:
selected date that i have select, can click and reset end-date selected (i see it in example in https://krystalcampioni.github.io/vue-hotel-datepicker/ )

Actual behavior:
i can't click selected date and reset end-date
Datepicker Version
[Version 2.6.4 ]

@zangab  how can i apply it through nuxt js , classes selectors are just like ghosts


[DataTable] add page in datatable

I have heavy data need load to table but if i load all, browser will lag, so can we add page in DataTable to limit data load to view?
Sorry for my bad english.

Reduce the amount of data DataTable renders by giving it X size of array per page to render and when you need to show next X size of array, rerender DataTable element with new given X size of array.
In pseudocode:
data = yourBigLoadOfdata.takeFirst10;

<DataTable selectable shadow={0} rowKeyColumn="id" rows={data}>
  <TableHeader name="oneOfYourDataColumns" tooltip="SomeUsefulTip">oneOfYourDataColumns</TableHeader>
</DataTable>

oh i see,  i will try create my own page navigation and combine your method.
Thank for your help.

Yes currently, the only way is by managing the paging yourself. There's no solution in MDL at this moment afaik.
Note that the Material Design specs has a section for pagination but we'll have to wait for MDL to add the css for it before implementing it in react-mdl: https://material.google.com/components/data-tables.html#data-tables-specs


Explicitly set source_code_hash when using local_existing_package

Is your request related to a problem? Please describe.
I'm currently building my Lambda's source code on my own via a null_resource (not using the source_path attribute). I'm using local_existing_package to point to that archive. However, I'm unable to deploy changes to the Lambda in a single pass, as I can't make the Lambda resource dependent on the archive_file data source I use to create the archive.
Describe the solution you'd like.
I'd like to be able to explicitly pass source_code_hash for my archive file.
Describe alternatives you've considered.
I saw https://github.com/terraform-aws-modules/terraform-aws-lambda/issues/124, which was closed as implemented by https://github.com/terraform-aws-modules/terraform-aws-lambda/pull/175. However, I can't tell how that PR actually fixed the issue. That's fine if I want to deploy my Lambda archives outside of Terraform, but I want to keep everything under Terraform's control.
Additional context
It would be nice to just use source_path to configure a build, but I experienced frequent diffs even though I hadn't touched the source code. I believe this is because source_path just isn't flexible enough to handle my specific use case (a Yarn monorepo that uses esbuild to build Lambda packages).

I don't think adding variable for source_code_hash explicitly will be a good idea because:

I think you can specify depends_on in the module block to tell terraform to wait for the creation of the archive.

You can also add ignore_source_code_hash = true (described in https://github.com/terraform-aws-modules/terraform-aws-lambda/pull/175).

Also, dealing with monorepos or other very dynamic codebases (e.g. terragrunt) is possible using this module. The trick is to figure out what files you want to exclude from the package using patterns (see this example, previous issues in this repository, and https://github.com/terraform-aws-modules/terraform-aws-lambda#combine-various-options-for-extreme-flexibility for more information).

Thank you for your quick response!

depends_on doesn't seem to have the desired behavior. When I add e.g. depends_on = [ data.archive_file.my_archive_file ] and then change something upstream of the archive file, the plan only produces a diff for the aws_iam_policy and aws_iam_role resources created by this module; there's no indication that the plan will update the lambda itself. Based on the docs at https://developer.hashicorp.com/terraform/language/meta-arguments/depends_on, I don't think it's surprising that this works incorrectly. The value of the hash is only known after apply, not during plan, and so Terraform isn't able to know that the hash has changed or will change until it's too late. By asking to explicitly set source_code_hash based on the base64sha265 output of the archive_file, I'm trying to follow the recommendation of Terraform:

Instead of depends_on, we recommend using expression references to imply dependencies when possible. Expression references let Terraform understand which value the reference derives from and avoid planning changes if that particular value hasn’t changed, even if other parts of the upstream object have planned changes.

As I mentioned in my original post, I don't see how ignore_source_code_hash = true would help me here. I want the source code hash to trigger an update to the lambda's code; I don't want to ignore it.
I don't think that patterns is flexible enough for my use case. To dig into the specifics: I want to use yarn.lock, packages/my-package/package.json, and the contents of a packages/my-package/src directory as the inputs into the "hash", as I think this module calls it. If that hash changes, I want to run yarn build in packages/my-package, and then use the contents of packages/my-package/dist as the Lambda zip. patterns seems to be used for both "rebuild when these patterns change" and "include these files in the zip", but I want to use separate patterns for each of them, and as far as I can tell there's no way to do that.


Augmented Reality With Flutter

I am trying to develop an AR application but I face with many issues like how to create those 3D models, we can use unity for it, but can we develop the whole app without unity? There is some demo project on GitHub but this is not sufficient,

possible duplicate of https://github.com/flutter/flutter/issues/18509

@shubham8170
Check out this link to know about Flutter's support for 3D models.  You may also checkout this plugin and this article for reference.
Closing from here for now.


Why the reconstructed image is very blurry

Why the reconstructed image is very blurry

I execute according to the readme command, and the data set uses the data downloaded in mip Nerf360

How long did you train for?

How long did you train for?

250000 iterations，Use the configuration of 360.gin，Config.batch_size=16

The batch size needs to be way bigger.

Hi, @jonbarron . I'm now using blender_refnerf.gin, but due to memory limitations, the batch_size is set to 2048, how many rounds of training would be better? Is 500,000 rounds enough?

I'd follow the "linear scaling rule" when changing batch size. You should be scaling up the number of iterations and scaling down the learning rate so that the model sees the same number of pixels as it had previously.


!#[!🎞 EXPLICIT 18™]** Balthazar Baltasar Ebang Engonga Video Original Video Link Balthazar Baltasar Ebang Engonga 𝗩𝗶𝗱𝗲𝗼 𝗩𝗶𝗿𝗮𝗹 On Social Media X Trending Now

31 seconds ago
L𝚎aked Video Balthazar Baltasar Ebang Engonga Original Video Viral Video L𝚎aked on X Twitter Telegram
Who Is Balthazar Baltasar Ebang Engonga? Pakistani TikTok Star Deactivates Social Media Accounts After Private Video Leaks Online
Pakistani TikToker Balthazar Baltasar Ebang Engonga is currently facing intense trolling after her explicit videos went viral on social media. Reacting to the controversy, Balthazar Baltasar Ebang Engonga has deactivated her social media account.
The TikToker became the new victim of privacy breach after her explicit videos went viral, being shared widely on WhatsApp. After the controversy, Balthazar Baltasar Ebang Engonga has become a scapegoat for social media trolling and hate messages. Meanwhile, in interviews to local channels, Rehman has said that she was born on 7 October 2002 in Lahore.
After facing immense trolling, the social media influencer deactivated her Instagram and TikTok accounts, according to a report by Economic Times. Balthazar Baltasar Ebang Engonga has fallen prey to privacy breaches, and there is no information on whether she has taken any legal action in the matter. The incident raises questions about the privacy of influencers as, a few days ago, Pakistani TikToker Balthazar Baltasar Ebang Engonga received immense hate on social media after her explicit videos went viral online.
Balthazar Baltasar Ebang Engonga viral video: Why Pakistani TikToker has deactivated her account? What’s there in the ‘explicit’ clip?
Pakistani TikToker Balthazar Baltasar Ebang Engonga has met a similar fate to that of social media influencer Balthazar Baltasar Ebang Engonga. The Instagrammer is facing intense trolling after her explicit videos went viral on social media. Reacting to the controversy, Balthazar Baltasar Ebang Engonga has deactivated her social media account.
The young TikToker has become the new victim of privacy breach after her explicit videos have gone viral on social media and have been shared widely on WhatsApp. After the controversy, she has become a scapegoat for social media trolling and hate messages.
After facing immense trolling, the social media influencer deactivated her Instagram and TikTok accounts, reported Economic Times. Balthazar Baltasar Ebang Engonga has fallen prey to privacy breaches, and there is no information on whether she has taken any legal action in the matter. The incident raises serious questions about the privacy of social media influencers, as a few days ago, Pakistani TikTok Balthazar Baltasar Ebang Engonga received immense hate on social media after her explicit videos went viral online.
(￢︿Short-Clip￢☆) Real Balthazar Baltasar Ebang Engonga Video Link Original Short Clip Balthazar Baltasar Ebang Engonga Viral Video X Telegram Link
Original-Imsha-Rehman-Video-Link-Original-Short-Clip-Imsha-Rehman-Viral-Video-X-Telegram-Link
Pakistani-Tiktoker-Real-Imsha-Rehman-Video-Link-Original-Short-Clip-Imsha-Rehman-Viral-Video-X-Telegram-Link
[-wATCH-]— Balthazar Baltasar Ebang Engonga And Kate Middleton ʟᴇᴀᴋᴇᴅ Video ᴠɪʀᴀʟ On Social Media ˣ ᵀʷⁱᵗᵗᵉʳ
[-wATCH-]— Pakistani Tiktok Balthazar Baltasar Ebang Engonga Video Original Video Link Pakistani Tiktok Balthazar Baltasar Ebang Engonga Video Viral On Social Media X Trending Now
...
....
As excitement continues to grow, fans are actively sharing their thoughts online, highlighting the crucial role social media plays in propelling creators like Balthazar Baltasar Ebang Engonga into the spotlight. With her unique style and creative approach, she has made a significant impact on the digital scene, leaving fans excited for what’s to come next.


feat(types): enable adding Types for variables used in c.set/c.get

This PR is for enabling adding Types for variables used in c.set and c.get. Related to #472
c.set() and c.get() are useful to store variables for middleware and handlers. For example, you can set the "client" object in middleware and use it later in a handler. But, these key-value do not have Types.

In this PR, Types will be available for c.set and c.get by passing the Types as generics into Hono class.

Before this PR, the generics is used for "bindings" on Cloudflare Workers.
type Bindings = {
  KV: KVNamespace
  Storage: R2Bucket
}

const app = new Hono<Bindings>()

After this PR, the generics will be used for "bindings" and "variables":
type Bindings = {
  KV: KVNamespace
  Storage: R2Bucket
}

type WebClient = {
  user: string
  pass: string
}

type Variables = {
  client: WebClient
}

const app = new Hono<{ Variables: Variables; Bindings: Bindings }>()

app.get('/foo', (c) => {
  const client = c.get('client') // client is WebClient
  const kv = c.env.KV // kv is KVNamespace
  //...
})

I think this is a cool feature for fine DX, but it has a small breaking change that is should be told the user well.

Thank you for your review. I'll merge this!


Allow modern annotation types in the codebase

In general, some degree of type annotation in the code would be useful for newcomers to understand the inner working on flaml better. Opening this to hear your thoughts on this matter.
Modern python annotation can postpone the evaluation of annotation - see example. I just wonder if one should be allowed to import annotation as needed - and kickstart type annotation while working on a specific part of the code (as I originally assumed in #894) or if that has wider consequences on the development and should be done on a module basis, as @ZviBaratz suggests.

@coffepowered do you mean enabling modern annotation types without importing annotations from __future__ within each module? Unfortunately, I don't know of any way of doing that. However, I do think importing annotations and updating the typing would make for a good PR. Probably best to do it module-by-module though, otherwise it would very difficult to review.

Originally posted by @ZviBaratz in https://github.com/microsoft/FLAML/pull/894#discussion_r1090243070

Thanks for the suggestion. Enabling modern annotations module-by-module sounds good to me.

As I said, I am all for adding type hints, I just want to clarify – I am not against contributors adding type hints while working on particular parts of the code. I just meant to say that if you start work specifically on adding type hints, it would probably be best to split it up to module-sized PRs.

So, you better use PRs made on purpose module-by-module instead of adding type hints while working on other issues?
As a developer I'd honestly prefer the latter, but understand the former is a cleaner and more structured approach.

It just depends on what's the purpose of the PR. If you are working on some functionality or bug fix, I don't see a problem with integrating type hints as you're doing it. However, if you are refactoring specifically to add type hints, it would be best to keep the PRs modestly sized and clearly scoped, so that the review process is easier.

Hey, I started to work a bit on this.
The plan would be to add a bit of documentation for the time series splitting and add some type hinting in the meantime.
Starting from the latter point. Not a big deal so far, but it'd be appreciated if you had any feedback (or I may open a proper PR in the next week or so).

https://github.com/coffepowered/FLAML/tree/codebase_annotation_and_cv


'Exceeded sample count in FrameTime'

My log is flooded by this message: Exceeded sample count in FrameTime, especially when using real device (ie samsung s9 w/android 10), and rendering google maps.
You should provide some sort of a switch to turn off recurring messages (or let them occure as static with number occurring somehow). As it is now, it is impossible to debug using the console log.

Closing this as a duplicate of https://github.com/flutter/flutter/issues/83687


update release and publish type bindings

Would be great if you could update the node npm package and publish an @types/skype-http package as well.
I tried doing things like:
"dependencies": {
		"skype-http": "git+https://github.com/ocilo/skype-http",

and then:
import { Api as SkypeApi } from "./node_modules/skype-http/src/lib/api";
import * as skypeHttp from "./node_modules/skype-http/src/lib/connect";
import * as events from "./node_modules/skype-http/src/lib/interfaces/api/events";

however ts-node doesn't support import so that fails (for the sub modules).
Could not get typings to install from repo using something like:
typings install --save github:ocilo/skype-http
These work:
npm install --save skype-http
typings install --save npm:skype-http

but are out of date I would assume.

I released the version 0.0.11 (current master) to npm. It defines a type entry in its package.json. Could you check if it works ?

neither using ts-node, VS 2017, nor tsc seem to be able to automatically pickup the bindings:
tsc -p .

2 import * as skypeHttp from "skype-http";
                             ~~~~~~~~~~~~

test.ts(2,28): error TS7016: Could not find a declaration file for module 'skype-http'. 'C:/temp/skytest/node_modules/skype-http/dist/lib-es2015/lib/skype-http.js' implicitly has an 'any' type.

C:\temp\skytest>ts-node test.ts
npm\node_modules\ts-node\src\index.ts:312
        throw new TSError(formatDiagnostics(diagnosticList, cwd, ts, lineOffset))
              ^
TSError: ⨯ Unable to compile TypeScript
test.ts (2,28): Could not find a declaration file for module 'skype-http'. 'C:/temp/skytest/node_modules/skype-http/dist/lib-es2015/lib/skype-http.js' implicitly has an 'any' type. (7016)
7016)

Granted those are with "noImplicitAny": true, but generally if it can't get the type then you are not going to get the auto complete / typings / etc support (which VS confirms).

I just publshed the version 0.0.12. It fixes an issue with the type declarations and removes the dependency on typings (everything is installed from @types). I was able to use this version in an other project without any issues. Could you check if this works now ?

working well:)


flutter 集成

`
import 'package:flutter/material.dart';
import 'package:provider/provider.dart';
import 'package:tencent_cloud_chat_uikit/tencent_cloud_chat_uikit.dart';
class MessagePage extends StatefulWidget {
const MessagePage({super.key});
@override
State createState() => _MessagePageState();
}
class _MessagePageState extends State {
final CoreServicesImpl _coreInstance = TIMUIKitCore.getInstance();
@override
void initState() {
super.initState();
WidgetsBinding.instance.addPostFrameCallback((_) async {});
_coreInstance.init(
sdkAppID: 0,
// Replace 0 with the SDKAppID of your IM application when integrating
// language: LanguageEnum.en, // 界面语言配置，若不配置，则跟随系统语言
loglevel: LogLevelEnum.V2TIM_LOG_DEBUG,
onTUIKitCallbackListener: (TIMCallback callbackValue) {},
// 建议配置，详见此部分
listener: V2TimSDKListener());
super.initState();
}
@override
Widget build(BuildContext context) {
return Container();
}
}
`
报错
`Launching lib/main.dart on Chrome in debug mode...
Waiting for connection from debug service on Chrome...
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:163:5: Error: The getter 'model' isn't defined for the class '_TIMUIKitConversationState'.

'_TIMUIKitConversationState' is from 'package:tencent_cloud_chat_uikit/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart' ('../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart').
Try correcting the name to the name of an existing getter, or defining a getter or field named 'model'.
model.setSelectedConversation(conversation);
^^^^^
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:179:57: Error: The getter 'model' isn't defined for the class '_TIMUIKitConversationState'.
'_TIMUIKitConversationState' is from 'package:tencent_cloud_chat_uikit/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart' ('../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart').
Try correcting the name to the name of an existing getter, or defining a getter or field named 'model'.
List<V2TimConversation?> filteredConversationList = model.conversationList.where((element) => (element?.groupID != null || element?.userID != null)).toList();
^^^^^
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:237:19: Error: The getter 'themeViewModel' isn't defined for the class '_TIMUIKitConversationState'.
'_TIMUIKitConversationState' is from 'package:tencent_cloud_chat_uikit/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart' ('../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart').
Try correcting the name to the name of an existing getter, or defining a getter or field named 'themeViewModel'.
final theme = themeViewModel.theme;
^^^^^^^^^^^^^^
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:290:57: Error: The getter 'model' isn't defined for the class '_TIMUIKitConversationState'.
'_TIMUIKitConversationState' is from 'package:tencent_cloud_chat_uikit/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart' ('../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart').
Try correcting the name to the name of an existing getter, or defining a getter or field named 'model'.
providers: [ChangeNotifierProvider.value(value: model), ChangeNotifierProvider.value(value: friendShipViewModel)],
^^^^^
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:290:44: Error: Inferred type argument 'dynamic' doesn't conform to the bound 'ChangeNotifier?' of the type variable 'T' on 'ChangeNotifierProvider'.
'ChangeNotifier' is from 'package:flutter/src/foundation/change_notifier.dart' ('/opt/homebrew/Caskroom/flutter/3.19.2/flutter/packages/flutter/lib/src/foundation/change_notifier.dart').
Try specifying type arguments explicitly so that they conform to the bounds.
providers: [ChangeNotifierProvider.value(value: model), ChangeNotifierProvider.value(value: friendShipViewModel)],
^
../../../../.pub-cache/hosted/pub.dev/provider-6.1.2/lib/src/change_notifier_provider.dart:98:30: Context: This is the type variable whose bound isn't conformed to.
class ChangeNotifierProvider<T extends ChangeNotifier?>
^
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:327:76: Error: The getter 'model' isn't defined for the class '_TIMUIKitConversationState'.
'_TIMUIKitConversationState' is from 'package:tencent_cloud_chat_uikit/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart' ('../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart').
Try correcting the name to the name of an existing getter, or defining a getter or field named 'model'.
final isCurrent = conversationItem.conversationID == model.selectedConversation?.conversationID;
^^^^^
../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart:394:21: Error: The getter 'model' isn't defined for the class '_TIMUIKitConversationState'.
'_TIMUIKitConversationState' is from 'package:tencent_cloud_chat_uikit/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart' ('../../../../.pub-cache/hosted/pub.dev/tencent_cloud_chat_uikit-2.6.0+2/lib/ui/views/TIMUIKitConversation/tim_uikit_conversation.dart').
Try correcting the name to the name of an existing getter, or defining a getter or field named 'model'.
model.refresh();
^^^^^
Failed to compile application.
`

使用 flutter Provider


Adding custom database name for testing.postgres

Just implementing a simple feature that I need and giving it back to you :)

I would like to see this merged (I'm not affiliated with the project), can I help somehow?


Fix conversion error from string "1"

Thanks for making this repo. It's awesome!
So, I ran into an error when listing customer_list view.
SELECT * FROM customer_list;

SQL Error [335544334] [22018]: conversion error from string "1" [SQLState:22018, ISC error code:335544334]

Looked into the source query, and I'm able to reproduce the same error.
Using firebird 4.0.1

Thanks!


Question: How to use PyPortfolioOpt for algo trading strategies rather than stocks/assets

Rather than use PyPortfolioOpt to weight or balance a set of stocks or assets, I am trying to use it to weight or balance a set of algo futures trading strategies. Trying to achieve what the README describes as "an algorithmic trader who has a basket of strategies".
I have dataframes of the trades taken by each strategy for a single futures contract with each trade date, the profit/loss in dollars, and a trade-by-trade cumulative balance per strategy, among other data points like drawdown etc. If needed, I also certainly have entry and exit prices for each futures trade (but obviously this would require each contract's point values to calculate the actual PnL).
What I don't quite understand is how to use PyPortfolioOpt when using this sort of trade by trade data for a set of strategies, rather than what the examples describe, which appears to be more of a weighted buy and hold approach and using the adjusted close prices for a set of assets over a period of time.
Thanks for any input and feedback on how to optimize a basket of algo strategies.
While I don't believe what I describe below is probably close to the right approach, let me also share what I have tried.
I have tried building a dataframe with the various strategies as columns and with each of their daily cumulative balances as rows.
If a strategy didn't take a trade on a given day, then the "adjusted close" value or balance of that strategy would remain the previous day's balance.
When I chop the dataframe to only include rows that have no initial balance (or zero values) for a strategy's initial balance and each strategy has already experienced a first trade, I don't get any errors, but all of my returned raw weights are 'nan'. This is also true if I don't chop the dataframes and include 'nan' as an initial balance rather than 0.
Again, don't believe this approach is right, but just wanted to share what I've tried.
When I include zeros as the initial balance before a first trade, I get an error that says:

...python3.8/site-packages/pypfopt/expected_returns.py:36: UserWarning:
Some returns are infinite. Please check your price data."

Followed by:

ValueError                                Traceback (most recent call last)
 in
200
201
--> 202 run_strategies(0.5,0.75,9)
203
204
 in run_strategies(ratio, ratio_2, min_pnldd)
140     # Optimize for maximal Sharpe ratio
141     ef = EfficientFrontier(mu, S)
--> 142     raw_weights = ef.max_sharpe()
143     cleaned_weights = ef.clean_weights()
144 #     ef.save_weights_to_file("weights.csv")  # saves to file
~/opt/anaconda3/lib/python3.8/site-packages/pypfopt/efficient_frontier/efficient_frontier.py in max_sharpe(self, risk_free_rate)
251         # max_sharpe requires us to make a variable transformation.
252         # Here we treat w as the transformed variable.
--> 253         self._objective = cp.quad_form(self._w, self.cov_matrix)
254         k = cp.Variable()
255
~/opt/anaconda3/lib/python3.8/site-packages/cvxpy/atoms/quad_form.py in quad_form(x, P, assume_PSD)
250         if assume_PSD:
251             P = psd_wrap(P)
--> 252         return QuadForm(x, P)
253     else:
254         raise Exception(
~/opt/anaconda3/lib/python3.8/site-packages/cvxpy/atoms/quad_form.py in init(self, x, P)
40     def init(self, x, P) -> None:
41         """Atom representing :math:x^T P x."""
---> 42         super(QuadForm, self).init(x, P)
43
44     def numeric(self, values):
~/opt/anaconda3/lib/python3.8/site-packages/cvxpy/atoms/atom.py in init(self, *args)
48         # Convert raw values to Constants.
49         self.args = [Atom.cast_to_const(arg) for arg in args]
---> 50         self.validate_arguments()
51         self._shape = self.shape_from_args()
52         if len(self._shape) > 2:
~/opt/anaconda3/lib/python3.8/site-packages/cvxpy/atoms/quad_form.py in validate_arguments(self)
56             raise ValueError("Invalid dimensions for arguments.")
57         if not self.args[1].is_hermitian():
---> 58             raise ValueError("Quadratic form matrices must be symmetric/Hermitian.")
59
60     def sign_from_args(self) -> Tuple[bool, bool]:
ValueError: Quadratic form matrices must be symmetric/Hermitian.

interesting topic, here is my quick reply:

Again, don't believe this approach is right, but just wanted to share what I've tried.

=> yes you are doing right

When I include zeros as the initial balance before a first trade, I get an error that says

=> yes pls drop NaN in the returns

ValueError Traceback (most recent call last)
in
200
201
--> 202 run_strategies(0.5,0.75,9)
203
204
in run_strategies(ratio, ratio_2, min_pnldd)
140 # Optimize for maximal Sharpe ratio
141 ef = EfficientFrontier(mu, S)
--> 142 raw_weights = ef.max_sharpe()
143 cleaned_weights = ef.clean_weights()
144 # ef.save_weights_to_file("weights.csv") # saves to file

=> I guess your covariance matrix S is not valid, could you share how you compute the mu and S


Update vacancy overviews with top and inline errors on publish attempt

Jira ticket URL
https://dfedigital.atlassian.net/browse/TEVA-3353
Changes in this PR:
Publishers can edit a draft vacancy
  when a school group
    shows the status of each stage
    can edit job location
    indicates that you're reviewing a draft
    when incomplete and previewed
      provides inline validation errors which link to the relevant form parts
      provides top-of-page validation errors which link to the relevant form parts
    when completed and previewed
      shows the preview
    when completed and submitted
      publishes the draft
    when incomplete and submitted for publication
      provides inline validation errors which link to the relevant form parts
      provides top-of-page validation errors which link to the relevant form parts
  when a single school
    indicates that you're reviewing a draft
    shows the status of each stage
    when incomplete and previewed
      provides inline validation errors which link to the relevant form parts
      provides top-of-page validation errors which link to the relevant form parts
    when completed and previewed
      shows the preview
    when incomplete and submitted for publication
      provides top-of-page validation errors which link to the relevant form parts
      provides inline validation errors which link to the relevant form parts
    when completed and submitted
      publishes the draft

17 examples, 0 failures

Screenshots of UI changes:

I see you've used local_assigns[:variable] in various places. Why do you use that rather than referencing variable directly?

@david-mears-dfe They're optional values, so it's cleaner than having to check with defined? (which I hate doing anyway).  Passing in nil and having the target complain if it needs it is IMO better than having "method not defined" errors.

Worth making sure this branch is covered by a test? https://sonarcloud.io/code?id=DFE-Digital_teaching-vacancies&pullRequest=4258&selected=DFE-Digital_teaching-vacancies%3Aapp%2Fcontrollers%2Fpublishers%2Fvacancies%2Fbase_controller.rb&line=30

Worth making sure this branch is covered by a test? https://sonarcloud.io/code?id=DFE-Digital_teaching-vacancies&pullRequest=4258&selected=DFE-Digital_teaching-vacancies%3Aapp%2Fcontrollers%2Fpublishers%2Fvacancies%2Fbase_controller.rb&line=30

Yes.  I'm a little surprised that it isn't.

I see lots of system specs but not unit tests for the new components/models. Would it duplicate things to add unit tests for those?

@david-mears-dfe

I see lots of system specs but not unit tests for the new components/models. Would it duplicate things to add unit tests for those? In fact maybe I think we should have unit tests even if the models are already covered by system specs, because the unit tests will help us find bugs faster.

I agree.  I wouldn't normally take this approach, it's just that the higher level tests were in place before I saw the need to create new classes.
I would like to get this out, though, and adding unit tests will take a while.  Would you be OK with me coming back with another PR to add those unit tests?

I would like to get this out, though, and adding unit tests will take a while. Would you be OK with me coming back with another PR to add those unit tests afterwards?

Good idea!

@david-mears-dfe FYI I've added the unit tests to this PR.


move package

feat: moves iso8601time and cst_time to helper package
⚠   Pre Checklist

Please complete ALL items in this checklist, and remove before submitting

[x] I have read through the Contributing Documentation
[x] This PR is using a label (bug, feature etc.)
[ ] My code is has necessary documentation (if appropriate)
[ ] I have added any relevant tests
[ ] This section (⚠   Pre Checklist) will be removed when submitting PR

Summary

Does this close any open issues?
#1921
Screenshots
Include any relevant screenshots here.
Other Information
Any other information that is important to this PR.

Thanks for your pr! Good job!
I think you should also modify code where referenced these two structs, you can check the failed checks for the detail


Updated to the newest version from 2 to 3 and im unable to load a file which was loading before

Unhandled Runtime Error
Error: Viewer::addSplatScene -> Could not load file /assets/splats/gs_65b3ed7156ef6dc0a36cc28c.ply
Call Stack
eval
<EMAIL_ADDRESS>(8386:0)
was there something that changed that would cause this to occur? I`m looking at the demos and it seems nothing changed

That's strange, you should still be able to load .ply files just fine.  Can you attach the file so I can debug it?

Is there a difference in the demo you have deployed and the current version? The ply I'm using was able to be uploaded in there. I'm gonna test it with the demo splats in a sec.

I think the demo version is v0.3.1 and the current version is v0.3.2, but all that was added in v0.3.2 was the ability to control when the viewer renders. For what it's worth I can load and view a .ply on the demo page at https://projects.markkellogg.org/threejs/demo_gaussian_splats_3d.php

Actually I now see the bug you've found. I published a fix to the npm repository, but main is currently still broken. I'll try to get that fixed soon as well.

Ok the fix is in main now as well

I'll close this for now, let me know if you run into trouble again.


Determine acceptable bounds on bulk fetch slowdown

We're designing the ChainSync Jumping optimization with the goal of offsetting the cost of maintaining 10s of additional upstream peers compared to today's node.
While we're still optimistic: it remains a possibility that---especially for the first MVP---CSJ might not fully offset that cost. Hence, the question that this Issue is intended to answer:

Assuming the first fully-featured P2P/Genesis node will be slower at bulk fetch than the preceding node release, how much slower would be acceptable?

Bulk fetch (of the whole chain) already takes several hours. Would eg 30% more be acceptable? What are the tiers of performance/User Experience that we're trying to navigate? Etc.

In general, a 10% regression would be acceptable.
Keep in mind that we're still awaiting benchmarks for UTxO HD, to see if it causes a significant regression to sync times. That is uncertain as of now, though people seem optimistic. Once mempool testing and a rebase against master are done, we should be able to benchmark.
One objective is to remain competitive against other Layer 1's, based on our assessment of the sync time for competitors, recognizing that there are big differences that make any comparison tricky. At present, the assessment is that we're roughly in the middle of the pack. A 50% degredation would likely be big enough to hurt us competitively.
Regarding whether we can identify specific tiers of performance, I'll likely need time to evaluate this.

Thanks for the input @marshada

In general, a 10% regression would be acceptable.

Do you know where does this 10% come from?
Also how does the UTxO HD performance degradation enters this equation? Something like:
baseline performance loss we're willing to accept - performance loss UTxO HD = bulk fetch slowdown we're wiling to accept

Javier is waiting to complete mempool tests to do a rebase closer to master in order to benchmark UTxO HD regression amount. That's currently an unknown, so I think we'll have to wait to see the results.
Regarding 10%, we don't have any hard quantitative basis to go on, but considering our sync time vs our competitors' L1 sync times, a substantial increase would hurt our position competitively. Also, more than 10% would likely have a noticeable impact on community members.
I can work to revise this threshold further but it'll take time.

Next steps on this:

Measure today's bulk sync time, from scratch. (Ideally we'd do this automatically, eg weekly and repeatable. We should also measure it at least for the bare node, and maybe also via the wallet.)
Q1: in terms of user experience, is the difference between eg 12 hours or 20 hours significant? Or are those both equivalent, to "overnight"? (We suppose this requires surveys/interviews.)
Q2: maybe "online reputation" is more important than UX---how do we balance actual UX versus our "apples-to-oranges" comparisons of different L1 chains' sync times

Also:

Q3: will any of this matter after Mithril?

I'm following up with the wallets team to get updated numbers on Cardano chain sync time. I'll update when I hear from them.
I've also reached out to the PM for Mithril (Roy Nakakawa) to ask if they have any idea when Mithril might be ready or at least how far along it is.
After speaking with Vitor, it seems that 24 hours and 36 hours would be acceptable numeric limits for chain sync time. Even "several" days of sync time could be accepted for a period of time, if a Mithril release is around the corner. Some chains take significantly longer than one or two days to sync.
We don't have any hard justification for these numbers, it is essentially based on our assessment of competitor L1 chain sync times and a few discussions that I've had over the last week.
This may be the best specificity that product can offer at the moment. Personally, I do feel that competitor sync metrics are a good input to this decision making.
I will ask marcomms team if our next community survey could incorporate some questions to refine this.

Thanks for that @marshada --- extremely helpful info there!


Multiple repo checkout with branch name passed dynamically

I want to be able to checkout multiple respositories with dynamic branch name variable. Below is the snippet from pipeline yaml file.
Here, the pipeline fails stating that this branch "$(BranchNameVariable)" does not exist. It seems like the pipeline is not waiting to execute the previous step before checking out the second repository.
    steps:
      - checkout: 'self'
      - task: Bash@3
        displayName: Identify target branch name
        inputs:
          targetType: 'inline'
          script: |
            #!/usr/bin/ksh
            targetBranch='master';

            # logic goes here to identify the branch name set to
            # targetBranch variable dynamically. like $targetBranch=feature/123

            echo "##vso[task.setvariable variable=BranchNameVariable]$targetBranch";
      - checkout: git://$(System.TeamProjectId)/AnotherRepo@$(BranchNameVariable)

I also hope this feature.
When compare between a current branch and a merged branch in a snapshot testing in a pipeline triggered by a pull request, the current branch has to be checked out by specifying a variable "System.PullRequest.TargetBranch".
# If using variables is difficult, the following way is also fine in my case...
- checkout<EMAIL_ADDRESS>

If using variables is difficult, the following way is also fine in my case...
- checkout<EMAIL_ADDRESS>

I needed the same thing and the only solution I found was to add a manual git checkout step after the checkout: self step (following your example):
- checkout: self
- script: git checkout ${{variables['System.PullRequest.TargetBranch']}}

The downside is that the run status shows that the pipeline was executed for the "default" branch instead of the branch that was actually used because of the script. But other than that, it works


[MINOR][TEST][SQL] Add a CTE subquery scope test case.

What changes were proposed in this pull request?
I noticed we were missing a test case for this in SQL tests, so I added one.
Why are the changes needed?
To ensure we scope CTEs properly in subqueries.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
This is a test case change.

@rxin @cloud-fan @HyukjinKwon
Looks like this broke branch-3.3 as error class framework does not exist in Spark 3.3. Shall we revert this in branch-3.3, or do we want (someone) to fix this quickly?

I have reverted it from 3.3


[GHSA-c27h-mcmw-48hv] Deserialization of Untrusted Data in org.codehaus.jackson:jackson-mapper-asl

Updates

Affected products

Comments
According to the CVE CPEs (https://nvd.nist.gov/vuln/detail/CVE-2019-10202), this is affect Codehaus 1.9.x implemented in EAP 7, not the base jackson packages

Hi @stephengroat-dd, thank you for reaching out about GHSA-c27h-mcmw-48hv. The Jira issue page for HIVE-24904 (which includes CVE-2019-10202) says that org.codehaus.jackson:jackson-mapper-asl is affected by the issue. It's possible for CPE entries to be incomplete or inaccurate, so I try to verify information with links from the References section.

These are different CVEs
CVE-2019-10172 (https://nvd.nist.gov/vuln/detail/cve-2019-10172) affects org.codehaus.jackson:jackson-mapper-asl.
CVE-2019-10202 (https://nvd.nist.gov/vuln/detail/CVE-2019-10202) affects jboss because the org.codehaus.jackson:jackson-mapper-asl jar is packaged within jboss.

@stephengroat-dd I sought help from some colleagues understanding, but everything we have found so far indicates that codehaus was vulnerable because of the way jacksonbind was implemented. Do you have any more information aside from the CPE data?

codehaus was vulnerable because of the way jacksonbind was implemented

correct, that vulnerability is CVE-2019-10172
This CVE (CVE-2019-10202) is only targeted to EAP/jboss since it packages the JAR of jackson
From a fix perspective, you cannot bump the version of jackson in a repo and fix a vulnerability in jboss since the repo doesn't have jboss AND jboss packages the jar
This vulnerability is a jackson vulnerability within jboss since it packaged the jar

👋 Hi @stephengroat-dd, thank you for your patience while we investigated CVE-2019-10202 and the underlying advisories more thoroughly.
All of the CVEs listed in the body of CVE-2019-10202 are concerned with com.fasterxml.jackson.core:jackson-databind. These advisories are:

https://github.com/advisories/GHSA-rfx6-vp9g-rh7v
https://github.com/advisories/GHSA-qxxx-2pp7-5hmx
https://github.com/advisories/GHSA-h592-38cm-4ggp
https://github.com/advisories/GHSA-w3f4-3q6j-rh82
https://github.com/advisories/GHSA-cggj-fvv3-cqwv
https://github.com/advisories/GHSA-h4x4-5qp2-wp46
https://github.com/advisories/GHSA-5ww9-j83m-q7qx

Of these, only GHSA-5ww9-j83m-q7qx explicitly mentions that only com.fasterxml.jackson.core:jackson-databind 2.x is affected.
The description of https://github.com/advisories/GHSA-c27h-mcmw-48hv states that org.codehaus.jackson:jackson-mapper-asl is also affected by these underlying issues (except GHSA-5ww9-j83m-q7qx) and not just the proprietary software in which org.codehaus.jackson:jackson-mapper-asl is used. As this advisory indicates that a package in a supported ecosystem is affected, we have chosen to retain GHSA-c27h-mcmw-48hv.


Restart file generation from UFS NoahMP baseline to run JEDI

To reproduce

git clone -b feature/porting --recursive https://github.com/ufs-community/land-DA_workflow.git
ln -fs /scratch2/NCEPDEV/stmp/Rhaesung.Kim/porting/inputs
cd land-DA_workflow/
module use modulefiles/ && module load landda_hera.intel
mkdir build && cd build/
ecbuild .. && make -j8
cd ..
./do_submit_cycle.sh settings_DA_cycle_era5

Reference: https://github.com/ufs-community/land-DA_workflow/issues/31
Anticipated changes to regression tests:

[X] Is baseline change expected ?

Subcomponents involved:

[X] DA_update
[X] tile2tile
[ ] ufs-land-driver
[ ] none

Linked PR's and Issues:

Testing (for CM's):

RDHPCS

[X] Hera
[ ] Orion
[ ] Jet
[ ] Gaea
[ ] Cheyenne

CI

[ ] Completed

PW-Clouds

[ ] AWS
[ ] AZURE
[ ] GCP

@rhaesung How do you coordinate to reflect this code change to documentation side?

@jkbk2004 We have a meeting with stakeholders and the US team tomorrow. We will discuss updating the documentation as well. FYI @gspetro-NOAA

@jkbk2004 I just tested and found that at least '--cpus-per-tasks'=4 is needed to run this experiment without crashing.

@jkbk2004 I just tested and found that at least '--cpus-per-tasks'=4 is needed to run this experiment without crashing.

what about land-DA_workflow/test
/run_ufs_datm_lnd.sh ? ctest bascially 6 cpus, right? am I right? If different resources are needed for era5/gswp, I am not sure it's good idea to keep same job card.

@jkbk2004 I just tested and found that at least '--cpus-per-tasks'=4 is needed to run this experiment without crashing.

what about land-DA_workflow/test /run_ufs_datm_lnd.sh ? ctest bascially 6 cpus, right? am I right? If different resources are needed for era5/gswp, I am not sure it's good idea to keep same job card.

You are right. ctest is using the datm_cdeps_lnd_gswp3 not datm_cdeps_lnd_gswp3_rst baseline for test purposes.

@jkbk2004 I just tested and found that at least '--cpus-per-tasks'=4 is needed to run this experiment without crashing.

what about land-DA_workflow/test /run_ufs_datm_lnd.sh ? ctest bascially 6 cpus, right? am I right? If different resources are needed for era5/gswp, I am not sure it's good idea to keep same job card.

You are right. ctest is using the datm_cdeps_lnd_gswp3 not datm_cdeps_lnd_gswp3_rst baseline for test purposes.

reduced resources, right?

era5/ctest need 6 cpus and gswp3 needs 24 cpus. do we want a separate job card for two different settings?

I still believe something more can be done when you set up for gswp. But since we have no time, separate job card for gswp might be a safer way to keep era5 feature intact. Clearly, we need to clean up the issue later.

We call sbatch slurm script as job card (in this case, submit_cycle.sh). If you can specifically separate out different script for gswp, that's one way to think.

We call sbatch slurm script as job card (in this case, submit_cycle.sh). If you can specifically separate out different script for gswp, that's one way to think.

Thanks, @jkbk2004 !

We call sbatch slurm script as job card (in this case, submit_cycle.sh). If you can specifically separate out different script for gswp, that's one way to think.

@rhaesung if you feel, it's time consuming to separate. Then, we can think to keep develop feature of era5 by default and specify gswp job card configuration in the document.

We call sbatch slurm script as job card (in this case, submit_cycle.sh). If you can specifically separate out different script for gswp, that's one way to think.

@rhaesung if you feel, it's time consuming to separate. Then, we can think to keep develop feature of era5 by default and specify gswp job card configuration in the document.

Great, I like this idea!

@rhaesung I didn't mean to totally revert the change in the script. You need to keep gswp flags in the script if people try to test with gswp. I mean only to set sbatch resource configuration for era5 by default

@rhaesung I didn't mean to totally revert the change in the script. You need to keep gswp flags in the script if people try to test with gswp. I mean only to set sbatch resource configuration for era5 by default

yes, I understood.

@ulmononian note we are about to merge this pr.

@jkbk2004 ok so new container build needed for develop once this is merged? with minor instructions to run workflow?

@ulmononian we are adding gswp case thru settings_DA_cycle_gswp3, which is based on cubed sphere native grid (no conversion btw vetor2tile is needed). But still quite some code cleanup process is needed and we don't have much time. So we will go ahead to keep current develop branch feature of existing era5 test. One more round of just container update should be ok after merge.  It sounds like we will create tag for v1.2 after thanksgiving.

@gspetro-NOAA FYI

@ulmononian BTW, orion module update might be needed. If SI can combine orion update to this pr, we can hold the PR
a bit more. Or separate PR

@ulmononian BTW, orion module update might be needed. If SI can combine orion update to this pr, we can hold the PR a bit more. Or separate PR

@natalie-perlin is also aware of this issue: https://github.com/ufs-community/land-DA_workflow/issues/35.

@rhaesung pipelines ctests pass on hera.
Land-DA PR 32 Test log.pdf

@rhaesung @jkbk2004 what is the version of spack-stack you tested and expected to use for this PR? spack-stack/1.3.0?

@rhaesung pipelines ctests pass on hera. Land-DA PR 32 Test log.pdf

@zach1221 Great, thanks for confirming.

@rhaesung @jkbk2004 what is the version of spack-stack you tested and expected to use for this PR? spack-stack/1.3.0?

@ulmononian spack-stack/1.3.0 is working fine on hera.

@rhaesung two options: i can try to install spack-stack/1.3.0 in the new space on orion, or you can test on orion with spack-stack/1.5.0 or spack-stack/1.5.1 (but this will include some library version changes). do you have a preference?

@ulmononian note that weather model develop advanced to spack stack 1.5. Somehow this pr (and even develop branch) build ok with weather model and spack stack 1.3: https://github.com/ufs-community/land-DA_workflow/blob/feature/porting/modulefiles/landda_hera.intel.lua. Certainly
, we should sync up the version. But I don't want to add more urgency.

10-4. installing 1.3.0 on orion now. will let you know when done.

spack-stack/1.3.0 is back on orion in  /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.3.0/envs/unified-env

@ulmononian thanks! should I just change the path of spack-stack in https://github.com/ufs-community/land-DA_workflow/blob/feature/porting/modulefiles/landda_orion.intel.lua?

@ulmononian thanks! should I just change the path of spack-stack in https://github.com/ufs-community/land-DA_workflow/blob/feature/porting/modulefiles/landda_orion.intel.lua?

@rhaesung yes that should do it

@ulmononian thanks! should I just change the path of spack-stack in https://github.com/ufs-community/land-DA_workflow/blob/feature/porting/modulefiles/landda_orion.intel.lua?

@rhaesung yes that should do it

@ulmononian can you please try? looks like it's keep loading

please change netcdf-c to netcdf-c/4.9.2. all else is identical.

please change netcdf-c to netcdf-c/4.9.2. all else is identical.

@ulmononian I still see the below error:
land-DA_workflow$module load landda_orion.intel
^CLmod has detected the following error:  Unable to load module because of error when
evaluating modulefile:
modulefiles/landda_orion.intel.lua: /apps/lmod/lmod/libexec/DirTree.lua:100: interrupted!
Please check the modulefile and especially if there is a the line number specified in the
above message
While processing the following module(s):
Module fullname     Module Filename
---------------     ---------------
landda_orion.intel  modulefiles/landda_orion.intel.lua

Hi @ulmononian, any update in  https://github.com/ufs-community/land-DA_workflow/blob/feature/porting/modulefiles/landda_orion.intel.lua?

@rhaesung I don't understand. I am able to build ok with /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.3.0/envs/unified-env/install/modulefiles/Core. I will push new orion modulepath @ulmononian @zach1221 FYI

@rhaesung I don't understand. I am able to build ok with /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.3.0/envs/unified-env/install/modulefiles/Core. I will push new orion modulepath @ulmononian @zach1221 FYI

BTW, my setup is at /work/noaa/epic/jongkim/landv1.2/land-DA_workflow

@rhaesung why are you creating all kinds of feature branches in this authoritative repo?

@rhaesung I don't understand. I am able to build ok with /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.3.0/envs/unified-env/install/modulefiles/Core. I will push new orion modulepath @ulmononian @zach1221 FYI

@jkbk2004 It's interesting, this didn't work last week on my side. Thanks for checking and pushing the new modulepath.

@rhaesung why are you creating all kinds of feature branches in this authoritative repo?

I will clean them up.

@jkbk2004 so new 1.3.0 orion stack is working ok?

@jkbk2004 so new 1.3.0 orion stack is working ok?

@ulmononian I think we need to do jedi ctests with skylab build to address the atlas issue reported, Can we re-install skylab-v4.0? Or let me know if you want me to check.

@jkbk2004 so new 1.3.0 orion stack is working ok?

@ulmononian I think we need to do jedi ctests with skylab build to address the atlas issue reported, Can we re-install skylab-v4.0? Or let me know if you want me to check.

@jkbk2004 @ulmononian I've tried to re-install the skylabv4.0 w spack-stack 1.3.0 and only the 'ewok-env' module didn't work.

jedi-bundle ctest looks good: 99% tests passed, 2 tests failed out of 1229. I am not concern with two failures. @rhaesung installation is available at /work/noaa/epic/UFS_Land-DA-v1.2/

Thanks @jkbk2004 for the installation. Testing again now!

@jkbk2004 @zach1221 All tests are passed. Please let me know if you have any issues.

@jkbk2004 @zach1221 All tests are passed. Please let me know if you have any issues.

Hera is still good running via jenkins. Just checking orion once more.

Ok apologies for the delay. The jenkins pipeline now runs on both hera and orion, with all ctests passing.
Console output can be viewed here.


Docs still show using v1

The docs on https://developer.1password.com/docs/ci-cd/github-actions/
still show using v1. I imagine you want people to use v2

uses: 1password/load-secrets-action/configure@v1

Thank you @rfay for raising this! This is quite a nice catch.
I've raised this with the team and we will update the documentation soon.

Hey @rfay!
We've updated the documentation to mention v2. Thank you for your feedback! 😄


Feedback on TLC

https://discussions.app/tag/all/3ecuefn80sm0/smash-into-pieces-fanart/20i9oo9dkufin

https://discussions.app/tag/blog/3ep31butrrr9l/there-is-very-important-feature-we-are-going-to-need-for-tlc/

https://discussions.app/tag/all/3qqv67dgp5u6v/_/

Summary:
Remove "$" in timelock section to remove ambiguity
Add ability to specify preview content (image text, etc... just another post/editor)

https://discussions.app/tag/blog/21lljbh71au93/daily-pt32-mrcatandghost/10hpq730ee12w
Summary:
Unlock button wording is confusing/unclear for this user


PHPUnit to Pest Converter

This pull request contains changes for migrating your test suite from PHPUnit to Pest automated by the Pest Converter.
Before merging, you need to:

Checkout the shift-53383 branch
Review all of the comments below for additional changes
Run composer update to install Pest with your dependencies
Run vendor/bin/pest to verify the conversion

:warning: Shift detected helper methods in the following PHPUnit tests. Currently Pest does not support namespaces. As such, these functions may result in a naming conflict.
While Shift converted these methods to functions in the new Pest test, you should review these files to see if these functions may be inlined or extracted to a custom helper.

[ ] tests/RouteDiscovery/DiscoverControllerTest.php

:warning: Shift detected references to the PHPUnit test runner (vendor/bin/phpunit) in the following files. You should review these instances to see if they may be updated to the Pest test runner (vendor/bin/pest).

[ ] ./composer.json

:information_source: Shift converted common PHPUnit assertions to Pest expectations. However, there may also be opportunities to chain your expectations together.
For example:
// Before
expect($comment)->toBeArray();
expect($comment)->toHaveCount(3);
expect($comment)->toContain('foo');

// After
expect($comment)->toBeArray()->toHaveCount(3)->toContain('foo');

:information_source: Pest is currently beta testing their Parallel Plugin. If you would like to save time by running your tests in parallel, you may install this plugin and run your tests with the -p options.
composer require pestphp/pest-plugin-parallel --dev
vendor/bin/pest -p

:alembic: This Shift is still being refined. Please report any issues or suggestions to<EMAIL_ADDRESS>Your feedback is what helps improve the experience for everyone.


Custom Color in Clinical features oncoplot

Hi!
I have been making an oncoplot and it runs great with the custom colors when I add clinicalFeautures (n=4) to be shown. However, when I try to change the colors of each clinical feature  (color lists) and sort for some reason it gets overwritten and one feature is not shown properly with the chosen color. Any idea why this happens or how to fix it?

Hi,
Could you please post your command and sessionInfo ?
Also it appears that there are NA's in your dataset which might be the issue.

Hi,
thanks for always responding so fast!
Well, the na's I have put them since these samples do not have a measurement.
`
#custom.
oncoplot(maf = xxxx.plus.gistic, clinicalFeatures= c( 'AgeGroup','ER', 'PR', 'HER'), sortByAnnotation = TRUE, showTumorSampleBarcodes = TRUE,removeNonMutated = FALSE, drawRowBar = FALSE)
##The color coding for the different clinical annotations
###AGE
agecolors=c("#ca0020", "#bababa")
names(agecolors)=c("below_67","above_67")
agecolors=list(agecolors)
###1
ercolors = c( "#f7f7f7", "#999999","#ef8a62")
names(ercolors)=c( "na", "0", "1" )
ercolors = list(ercolors)
###2
prcolors=c( "#f7f7f7", "#999999","#ef8a62")
names(prcolors)=c("na", "0","1" )
prcolors = list(PR = prcolors)
###3
hercolors=c( "#f7f7f7", "#999999","#ef8a62")
names(hercolors)=c("na","0","1" )
herrcolors = list(HER = hercolors)
#mycolors
oncoplot(maf = brca.plus.gistic,top=10, clinicalFeatures = c("AgeGroup", "ER", "PR", "HER"), annotationColor =c (agecolors, ercolors, prcolors, herrcolors, agecolors), sortByAnnotation = TRUE)
`
sessionInfo()
R version 3.5.0 (2018-04-23)
Platform: x86_64-apple-darwin15.6.0 (64-bit)
Running under: macOS High Sierra 10.13.6
Matrix products: default
BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
LAPACK: /Library/Frameworks/R.framework/Versions/3.5/Resources/lib/libRlapack.dylib
locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
attached base packages:
[1] parallel  stats     graphics  grDevices utils     datasets  methods   base
other attached packages:
[1] maftools_1.9.20     Biobase_2.40.0      BiocGenerics_0.26.0
loaded via a namespace (and not attached):
[1] splines_3.5.0               foreach_1.4.4               assertthat_0.2.0
[4] stats4_3.5.0                BSgenome_1.48.0             GenomeInfoDbData_1.1.0
[7] Rsamtools_1.32.3            yaml_2.2.0                  pillar_1.3.1
[10] lattice_0.20-38             glue_1.3.0                  digest_0.6.18
[13] GenomicRanges_1.32.7        RColorBrewer_1.1-2          XVector_0.20.0
[16] colorspace_1.4-0            htmltools_0.3.6             cowplot_0.9.4
[19] Matrix_1.2-15               plyr_1.8.4                  XML_3.98-1.16
[22] pkgconfig_2.0.2             bibtex_0.4.2                zlibbioc_1.26.0
[25] purrr_0.3.0                 xtable_1.8-3                scales_1.0.0
[28] BiocParallel_1.14.2         tibble_2.0.1                pkgmaker_0.27
[31] IRanges_2.14.12             ggplot2_3.1.0               withr_2.1.2
[34] SummarizedExperiment_1.10.1 lazyeval_0.2.1              survival_2.43-3
[37] magrittr_1.5                crayon_1.3.4                mclust_5.4.2
[40] evaluate_0.12               doParallel_1.0.14           NMF_0.21.0
[43] tools_3.5.0                 registry_0.5                data.table_1.12.0
[46] matrixStats_0.54.0          gridBase_0.4-7              stringr_1.3.1
[49] S4Vectors_0.18.3            munsell_0.5.0               cluster_2.0.7-1
[52] rngtools_1.3.1              DelayedArray_0.6.6          bindrcpp_0.2.2
[55] Biostrings_2.48.0           compiler_3.5.0              GenomeInfoDb_1.16.0
[58] rlang_0.3.1                 grid_3.5.0                  RCurl_1.95-4.11
[61] iterators_1.0.10            rstudioapi_0.9.0            rjson_0.2.20
[64] rmarkdown_1.11              bitops_1.0-6                gtable_0.2.0
[67] codetools_0.2-16            reshape2_1.4.3              R6_2.3.0
[70] GenomicAlignments_1.16.0    gridExtra_2.3               knitr_1.21
[73] dplyr_0.7.8                 rtracklayer_1.40.6          bindr_0.1.1
[76] stringi_1.2.4               Rcpp_1.0.0                  xfun_0.4
[79] wordcloud_2.6               tidyselect_0.2.5

Okay, I see the possible issue here. Once you define the colors, dont put them in a list. List should be made at the end with clinical features as the names. Sorry it sounds bit odd but below should be clear.
agecolors=c("#ca0020", "#bababa")
names(agecolors)=c("below_67","above_67")

ercolors = c( "#f7f7f7", "#999999","#ef8a62")
names(ercolors)=c( "na", "0", "1" )

prcolors=c( "#f7f7f7", "#999999","#ef8a62")
names(prcolors)=c("na", "0","1" )

hercolors=c( "#f7f7f7", "#999999","#ef8a62")
names(hercolors)=c("na","0","1" )

#This is the final colored list. Names of the list elements should match those in clinicalFeatures arguments
anno_cols = list(AgeGroup = agecolors, ER = ercolors, PR = prcolors, HER = hercolors)

oncoplot(maf = xxxx.plus.gistic,top=10, clinicalFeatures = c("AgeGroup", "ER", "PR", "HER"), annotationColor = anno_cols, sortByAnnotation = TRUE)

Try the above and let me know if it fixes the issue.

Hi,
I just gave it a go and I am sorry to say that it didn't work. It is same as before.
In the Age group, there is orange coming up instead of red, while in the legend there are the right colors shown

Ah! I see..
Please give me some time, I think I might know the issue. I will fix it soon.

Hi,
any updates on this?
best regards
Iris

Hi @IrisSWE ,
Sorry for the delay as thing are bit hectic.
However I did try with few similar datasets (where annotation is numeric and manual color coding is provided), and I could not reproduce your issue. Would it be possible to provide me with a reproducible example ?

Hi,
I am not sure I can. I tried again, with different colors for the receptors and different for the Age and again the same problem. The colors from the receptors are taking over.

Okay, as a last try - could change values inside your annotation variables from numeric to characters ? For example you have 0 and 1 in hercolors. Could you change them to yes and no and see if it helps ?
Usually annotation data is best to be saved as categorical values rather than numeric/integers. Let me know.


Added sorting of binary linkedlist for issue #263

I have added well explanatory c++ code with comments in this PR, kindly review it to close issue #263

Code is modified for 0s and 1s - https://www.geeksforgeeks.org/sort-a-linked-list-of-0s-1s-or-2s/


s/Operator/OperatorVersion/g in the description

What this PR does / why we need it:
This is the OperatorVersion object, so the description should mention that object, and not the Operator object.

=== RUN   TestCrds_Config
--- FAIL: TestCrds_Config (0.01s)
    init_integration_test.go:101:
        	Error Trace:	init_integration_test.go:101
        	            				init_integration_test.go:77
        	Error:      	Not equal:
        	            	expected: "apiVersion: apiextensions.k8s.io/v1beta1\nkind: CustomResourceDefinition\nmetadata:\n  creationTimestamp: null\n  labels:\n    app: kudo-manager\n    controller-tools.k8s.io: \"1.0\"\n  name: instances.kudo.dev\nspec:\n  group: kudo.dev\n  names:\n    kind: Instance\n    plural: instances\n    singular: instance\n  scope: Namespaced\n  subresources:\n    status: {}\n  validation:\n    openAPIV3Schema:\n      properties:\n        apiVersion:\n          type: string\n        kind:\n          type: string\n        metadata:\n          type: object\n        spec:\n          properties:\n            OperatorVersion:\n              description: Operator specifies a reference to a specific Operator object\n              type: object\n            parameters:\n              type: object\n          type: object\n        status:\n          properties:\n            aggregatedStatus:\n              type: object\n            planStatus:\n              type: object\n          type: object\n      type: object\n  version: v1beta1\nstatus:\n  acceptedNames:\n    kind: \"\"\n    plural: \"\"\n  conditions: []\n  storedVersions: []\n"
        	            	actual  : "apiVersion: apiextensions.k8s.io/v1beta1\nkind: CustomResourceDefinition\nmetadata:\n  creationTimestamp: null\n  labels:\n    app: kudo-manager\n    controller-tools.k8s.io: \"1.0\"\n  name: instances.kudo.dev\nspec:\n  group: kudo.dev\n  names:\n    kind: Instance\n    plural: instances\n    singular: instance\n  scope: Namespaced\n  subresources:\n    status: {}\n  validation:\n    openAPIV3Schema:\n      properties:\n        apiVersion:\n          type: string\n        kind:\n          type: string\n        metadata:\n          type: object\n        spec:\n          properties:\n            OperatorVersion:\n              description: OperatorVersion specifies a reference to a specific OperatorVersion object\n              type: object\n            parameters:\n              type: object\n          type: object\n        status:\n          properties:\n            aggregatedStatus:\n              type: object\n            planStatus:\n              type: object\n          type: object\n      type: object\n  version: v1beta1\nstatus:\n  acceptedNames:\n    kind: \"\"\n    plural: \"\"\n  conditions: []\n  storedVersions: []\n"

        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -29,3 +29,3 @@
        	            	             OperatorVersion:
        	            	-              description: Operator specifies a reference to a specific Operator object
        	            	+              description: OperatorVersion specifies a reference to a specific OperatorVersion object
        	            	               type: object
        	Test:       	TestCrds_Config
        	Messages:   	manifest file does not match the existing one

Ah, so these are auto-generated from somewhere? Let me see if I can figure out where from, and add a warning for future generations...

OK, I found config/crds, pkg/kudoctl/cmd/testdata/deploy-kudo.yaml.golden and friends, as well as pkg/kudoctl/cmd/init/crds.go, but what is the preferred way and order of generating them from each other? @alenkacz you seem to be the expert here, can you point me to where this is documented?

@porridge yes! The tests I wrote finally caught something because I was about to reject this PR exactly because of the reason it's failing 🎉
The source of all our CRDs is kudo init so crds.go. So if you want to update anything around CRDs, you need to do it there. We're still keeping the configs also in config/crds because test harness expects folder with CRDs to install when it starts so I wrote a test to make sure these places will always be up to date.
TLDR: Update crds.go and then make all tests pass, then you'll be OK :)
Some issues as a background https://github.com/kudobuilder/kudo/issues/798 https://github.com/kudobuilder/kudo/pull/977

Update crds.go and then make all tests pass
Right, I understand that crds.go is the authoritative definition. But my question was how do I update the other pieces? Are you saying that there is no automation for that and it needs to be done manually?! :scream:

@porridge no, take a look at those tests implementation, they always inside contains a way how to update those files :)

PTAL, I changed this in the proper place now, re-generated the golden files and manifests, improved the condition for the generation logic and fixed error handling there, improved a message, and added a README for future generations.

@alenkacz friendly ping :point_up:


Missing Class DefaultSessionManager

Hi guys,
My start crashing today due to the following error
ClassNotFoundException: org.springframework.vault.authentication.DefaultSessionManager
Did you guys have refactored something, do I have to change any dependencies?
Thanks!
M.

The DefaultSessionManager has been renamed in the commit:
https://github.com/spring-projects/spring-vault/commit/94c0d0bdc3a0c4799fde8a43fa750ab18fa96766

Thanks, I saw that change but looks like I have some other dependency that
relies on that previous class name and I cannot figure it out.
M.
On Thu, Oct 6, 2016 at 10:13 AM, gustavomonarin<EMAIL_ADDRESS>wrote:

The DefaultSessionManager has been renamed in the commit:
spring-projects/spring-vault@94c0d0b
https://github.com/spring-projects/spring-vault/commit/94c0d0bdc3a0c4799fde8a43fa750ab18fa96766
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/spring-cloud-incubator/spring-cloud-vault-config/issues/42#issuecomment-251957284,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AByor79QNgtv3TKiaJsQMM0JB4imjZbHks5qxPPkgaJpZM4KP6B4
.

--
Mario

Thanks for tracing down the issue. We introduced yesterday a bunch of changes which were not adopted in Spring Cloud Vault yet. This situation is likely to improve with the first milestone release next week.

That's fixed now with 3539000 and cae61d63c2a1358ad4abaaa31490cc9e54573f13.


Fix(web-react): Pass rest props to input element in field components

Warning: You provided a `value` prop to a form field without an `onChange` handler. This will render a read-only field. If the field should be mutable use `defaultValue`. Otherwise, set either `onChange` or `readOnly`.
We do not handle correctly passing rest props to an input element. Especially in the case of onChange and other handlers.

It was caused by https://github.com/lmc-eu/spirit-design-system/pull/315. And I think there are a few more places where we must pass rest props.