connect ETIMEDOUT error, when doing mup setup/deploy

I tried to deploy my website using Meteor Up.  I configured my mup.json file as follows:
{
// Server authentication info
"servers": [
{
"host": "ec2-52-24-95-147.us-west-2.compute.amazonaws.com",
"username": "ubuntu",
//"password": "password"
// or pem file (ssh based authentication)
"pem": "C:/Users/Joachim/meteor.pem"
}
],
// Install MongoDB in the server, does not destroy local MongoDB on future setup
"setupMongo": true,
// WARNING: Node.js is required! Only skip if you already have Node.js installed on server.
"setupNode": true,
// WARNING: If nodeVersion omitted will setup 0.10.36 by default. Do not use v, only version number.
"nodeVersion": "0.10.35",
// Install PhantomJS in the server
"setupPhantom": false,
// Show a progress bar during the upload of the bundle to the server.
// Might cause an error in some rare cases if set to true, for instance in Shippable CI
"enableUploadProgressBar": true,
// Application name (No spaces)
"appName": "Homepage",
// Location of app (local directory)
"app": "C:/website",
// Configure environment
"env": {
"ROOT_URL": "ec2-52-24-95-147.us-west-2.compute.amazonaws.com",
"PORT": 80,
"METEOR_ENV": "production"
},
// Meteor Up checks if the app comes online just after the deployment
// before mup checks that, it will wait for no. of seconds configured below
"deployCheckWaitTime": 15
}
the error that it is displaying is the following:
throw er; // Unhandled 'error' event
^
Error: connect ETIMEDOUT {public IP from AWS}:22
at Object.exports._errnoExcpetion (util.js:837:11)
at exports._excpetionWithHostPort (util.js:860:20)
at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1060:14)
does anyone have any idea what is going on?

Same kind of problem here, this appeared overnight, I suspect the package server to be unavailable for some reason. I am not using mup for this project but the error I get is:
=> Errors while initializing project:

While downloading<EMAIL_ADDRESS>error: connect ETIMEDOUT

While downloading<EMAIL_ADDRESS>error: connect ETIMEDOUT

While downloading<EMAIL_ADDRESS>error: connect ETIMEDOUT

While downloading<EMAIL_ADDRESS>error: connect ETIMEDOUT

While downloading<EMAIL_ADDRESS>error: connect ETIMEDOUT

The server is not behind a firewall and has full access however using a different internet provider solved my problem, (some ip seems unreachable with my regular one) using a VPN could also have been an option (better this way than connecting from a phone / other internet provider…).


Update create_agent.py

Enhancements to Agent's Conversation and Tool Management Capabilities
Description
This pull request introduces significant enhancements to the agent's conversation and tool management capabilities within the fastrag/agents/create_agent.py module. The primary objective of these changes is to improve the handling of conversation memory and tool execution, thereby enhancing the agent's overall functionality and traceability during development.\n\nKey updates include the introduction of new classes and methods, such as EnhancedConversationMemory and EnhancedToolsManager, which extend existing functionalities to provide better tracking of tool usage and user data, as well as improved error handling and execution logging. Additionally, a DEBUG_MODE has been introduced to facilitate debug logging throughout the module, aiding developers in tracing and debugging the agent's operations more effectively.\n\nThe configuration loading and generator setup processes have also been refined to support these new features, ensuring seamless integration and improved performance.
Summary
Introduced EnhancedConversationMemory class:\n  - Extends ConversationMemory to include tool_history, user_data, and system_configs.\n  - Added add_interaction() method to log interactions with optional metadata, improving memory tracking.\n* Introduced EnhancedToolsManager class:\n  - Extends ToolsManager to include tool_execution_history.\n  - Added execute_tool() method with enhanced error handling and logging, improving tool management.\n* Updated get_generator() function:\n  - Now returns both generator and tokenizer.\n  - Added debug logging for model configuration, aiding in configuration traceability.\n* Modified get_basic_conversation_pipeline() function:\n  - Adjusted to return generator, tokenizer, and tools_objects_map.\n  - Added debug logging for loaded configuration, enhancing visibility into the pipeline setup.\n* Updated get_agent_conversation_pipeline() function:\n  - Now utilizes EnhancedToolsManager and EnhancedConversationMemory.\n  - Supports custom instructions for agent system roles, providing greater flexibility in agent configuration.\n* Removed replace_class_names_with_types() function, simplifying the configuration handling process.\n* Improved handling of tool configuration and instantiation, ensuring better integration and performance.\n* Enhanced the agent's initialization process to incorporate the new memory and tools manager classes, improving the agent's operational capabilities.\n\nThese changes collectively enhance the agent's ability to manage conversations and tools more effectively, providing developers with improved tools for debugging and extending the agent's functionality.


Plumb only network room

Allow admins to open a network room that is only used for plumbing.
This helps separate personal use from plumbing.

This was fixed in 1.5.0 with the --new argument to OPEN.


Fix vendored dependency issue (guava)

This was causing precommits to fail

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

Can one of the admins verify this patch?

Can one of the admins verify this patch?

If we do fix forward (instead of rollback #22044) there are also several checkStyle violations in tests

Yeah, good call - I'm not 100% sure we want to do this yet FWIW, but I lean towards doing it if its a small change (which it should be)

hm these checks are disabled for local tests, but they run on jenkins. You should be able to run a ...:checkStyle task to get them to reprodue locally, I believe
or ...:javaCompile  with -Werror or something like that. Can you run ...:tasks --all and find the checkstyle task?


Fixed toolbar issue with RTL #961

Task/Issue URL: https://github.com/duckduckgo/Android/issues/961
Tech Design URL: N/A
CC:
Description:
Switcher button is not visible on RTL language
Steps to test this PR:

Use RTL language or RTL developer mode.
Run app and try to open new tab.
The switcher button Is not visible.

Overview:
Before changes toolbar layout:

After changes toolbar layout:

Layout inspector:

Will review the fix within this week. thanks.


Commander: start pulling arming related parts into separate folder

Describe problem solved by this pull request
Goal: The user knows in advance if he'll be able to arm.
Describe your solution
First step: Pull things that relate to arming logic into the folder Arming and make sure to have a clear interface for all checks that happen before arming can take place
Describe possible alternatives
Hack my way through commander trying to run important bits and pieces in a random and unmaintainable way.
Test data / coverage
Only draft yet but I'm constantly testing every single step by using the existing unit-sitl tests and my own sitl testing. Hopefully I try to get to the point where efficient gtest unit testing is possible.

Goal: The user knows in advance if he'll be able to arm.

That is a revolution

Related? https://github.com/PX4/Firmware/pull/13025 https://github.com/PX4/Firmware/pull/12989

@ndepal Definitely related. Thanks for referencing. I can rebase either way no matter which one goes first.

Glad to see some movement here!
One thing I'd like to get sorted out is the line between preflight, prearm, and checks that can run continuously.
I'm wondering if we can get to the point where nearly everything results in status flags and have the arming machine act on that data rather than actually executing the checks.
The other missing piece is fitting this into mavlink.

@dagar Thanks for looking over it and your input! I try to share as many thoughts as possible. I want to first get it all in a less interdependent and hence more maintainable adaptable state.

I'd like to get sorted out is the line between preflight, prearm

My intentions after talking to a bunch of people about this: Preflight checks are the ones that determine if you can fly or not (user-focused), the pre arm checks (I left the name for now but it might not make sense anymore) are just one kind of preflight check since they prevent arming and hence flying.

and checks that can run continuously.
I'm wondering if we can get to the point where nearly everything results in status flags and have the arming machine act on that data rather than actually executing the checks.

Exactly the intention and why I started refactoring this. The goal is that there is no check that was not done before giving an arm command/input, no surprises to the user anymore. The arming state machine itself just knows if there's green light.

The other missing piece is fitting this into mavlink.

I agree, first I have to leave the strings but have them all optional (to not spam), then I plan to fill the flags at the beginning of https://mavlink.io/en/messages/common.html#SYS_STATUS as in-between solution and eventually we'll have the events interface taking care of delivering the status to the UI.

Perhaps not what you want to tackle here, but I'm wondering if all this sensors code should be owned by the sensors module. Then a higher level sensors status would be published for commander to act on.

I thought exactly the same let's go in steps.
My currently intended steps:

pull all checks together into PreFlightCheck into as small of an include and symbol scope as possible, dependencies get clear
make sure checks are callable without output and with one single call covering all desired checks
refactor code of checks, I saw they add up to >1200 lines of code which is almost not possible without duplication and there are better places for certain checks e.g. where the data of interest is produced or consumed

This PR should only do the first point otherwise it gets too big of a change.

@dagar @bresch I rebased on master with the only relatively trivial conflict of these lines:
https://github.com/PX4/Firmware/commit/549fb0d5de8a8eaebaa54d6e4d458876b53b60d2#diff-a2bcb238e25d8a97ab2aee48f54dbc48R497-R513
It would be nice to get this in soon. I can rebase other conflicting prs easily.

tested on pixhawk4 v5 f-450
pixhawk v4pro f-450

change to master firmware  not issues

Preflight fail: heading estimate not stable, unable to arm.

This was a bug introduced with https://github.com/PX4/Firmware/pull/13036 and fixed in https://github.com/PX4/Firmware/pull/13261 and https://github.com/PX4/Firmware/pull/13267. I was unlucky to have master at the exact time it was broken as my base. I'll rebase and this will fix the problem.

Thanks for the reviews and comments also from @bkueng.
I rebased, removed the funtional commit since like @dagar mentioned they don't really help by themselfes yet and addressed all the comments about includes with respect to folders in the last commit.

I'm assuming CI problems are now unrelated. It's ready for review check.

Looks good to me. Can you rebase?

Rebased
The conflict was just these four space characters: https://github.com/PX4/Firmware/commit/a475d71ca975c3343f56eb91412231486e014604#diff-eb94b84d1c6e5b1530f8ad834cef9b22R3761

Fixed style using rebase in https://github.com/PX4/Firmware/compare/856bca21538ee02c66fde813d666d3eebac6e75d..fbaee7624805c46309318d20fa2815ad34dcdc1b

Upon request of @dagar I did a quick test on a real vehicle with a pixhawk 4 mini. I can normally arm and fly when all checks pass. When the vehicle is upside down I can't arm because of the failing roll check.


Android Sentry initialization

Description
Sentry initialisation for android to enable error reporting
Project linked  here
Also

Add any other relevant change made on this PR.

Notes

Describe your changes

Tests Added / Updated?
Tried adding sentry.capture exception and forcing an exception in the PIN and PAN constructors
Screenshots

Thank you for adding Sentry, @anusha-bharat
Can we test whether Sentry.captureMessage("test android-sdk error") works?

Tested both locally and on android emulator

Can we test whether uncaught exceptions/crashes get reported to Sentry?
throw RuntimeException("This is a crash")

As discussed on slack huddle crashes and undefined exceptions alert on Sentry only when the app is reopened. That is expected behavior based on sentry docs


Catch up to changing Capistrano 3.5.0

Capistrano 3.5.0 has many changes.

https://github.com/capistrano/capistrano/blob/master/CHANGELOG.md#350

In order to notify Slack using Slackistrano, I think that it is necessary to catch up with some changes.

:+1:


DataFrame TableProvider Circular Reference

Describe the bug
Currently DataFrame implements TableProvider allowing it to be registered on a SessionContext, this will often be the same SessionContext from which its Arc<RwLock<SessionState>> came. For example
#[tokio::test]
    async fn register_table() -> Result<()> {
        let df = test_table().await?.select_columns(&["c1", "c12"])?;
        let ctx = SessionContext::new();
        let df_impl = Arc::new(DataFrame::new(ctx.state.clone(), &df.plan.clone()));

        // register a dataframe as a table
        ctx.register_table("test_table", df_impl.clone())?;

This will result in a circular reference that will prevent destruction of the SchemaProvider and the DataFrame.
To Reproduce
Inspect code
Expected behavior
It should not be possible to introduce circular dependencies. On a more holistic level, I'm not entirely sure what the purpose of this API is. Perhaps it could be removed and replaced with a combination of DataFrame::to_logical_plan and ViewTable (once #2657 is fixed)
Additional context
https://github.com/apache/arrow-datafusion/issues/2658
FYI @yjshen @xudong963

FYI some additional context on this is https://github.com/apache/arrow-datafusion/issues/1698 and https://github.com/apache/arrow-datafusion/pull/1699.  Basically the idea was to enable registering a DataFrame as a table i.e. with a name.

What did you think about this?

Perhaps it could be removed and replaced with a combination of DataFrame::to_logical_plan and ViewTable

Sounds good to me - is your idea to add a method like a ctx.register_dataframe method that would convert the DataFrame to a logical plan and register as ViewTable?


CelebA generated images are all red.

Regardless of OPTION values, all samples look bad. Any one who solved?

use this code  https://github.com/benckx/DCGAN-tensorflow
and use grid_height 1 and grid_width number-of-images
while tetsting keep the folder name same it works


Issue 1211: Update the inceptionYear in all pom.xml files to 2019

The commit log is a little screwy because my email was configured wrong on my machine, which I have since changed. Should be fine next commit.

@syakubov :
You have broken the build. Could you please make sure that you don't have duplicate tags in the same pom.xml and sort this out? Thanks! :)

Sorry about that. Should be fine now @carlspring

Thanks for your contribution! :)


DRILL-7973: Fix GitHub CI intermittent failures

DRILL-7973: Fix GitHub CI intermittent failures
Description

Disable flaky Splunk test
DdirectMemoryMb=2500 -DmemoryMb=1600
fail-fast: false
Update cache version
Fix flaky TestHttpPlugin#testSlowResponse
Enable some ignored tests in TestDrillbitResilience
Set timout for every test in TestDrillbitResilience to 5min
Migrate TestDrillbitResilience from junit4 to junit5
Release resources in the @AfterEach method in TestDrillbitResilience

Documentation
NA
Testing
Existing test cases are improved

The GitHub CI is not running for this PR because I used up it for testing purposes and achieve the limit.
The story of runs is available here:
https://github.com/vdiravka/drill/commits/DRILL-7973?before=96fde910221cf22c837510adb194419035d8c318+35&branch=DRILL-7973
Let's move it from draft, once GitHub CI is available again.

@vdiravka It looks like this is finally passing!  Nice work!

@vdiravka
Thanks for all your work on this.  Do you think we're ready to merge this or do you want to re-run a few more times?

@vdiravka I do still get the sense that moving our 100-minute limit to e.g. 120 minutes might help.  If you look at PR #2328, one build succeeded after 95 minutes while two timed out at 100 minutes.


pythonPackages.sympy: add antlr4 dep

antlr is necessary for sympy to be able to parse latex input (see the bottom of this page).

Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Notify maintainers
cc @

Is it a mandatory dependency (that is, it is in install_requires), or an optional dependency?

Fair point, only necessary if you need latex parsing (not sure if it's used anywhere else). Shall I change it to an option defaulting to false?

Happy to close this if you don't feel it's necessary since it's an optional dependency.

unfortunately there's a mismatch in abstractions between nix and python packages, in which this scenario doesn't have a great solution.
The most proper course of action would be include the related antlr4 package in the environment in which you need it.

Sounds good, thanks for the response @jonringer. Closing this.


more norms

addressing some of the issues in https://github.com/clulab/processors/issues/642
adding relevant tests
allowing a negative check in numerical entity tests (e.g., to make sure we did not extract 108.0 in from Sahel 108 in Senegal)

@kwalcock would you please give me the power to check what jenkins is up to?

Hi @kwalcock, I notice that the version in project is still the old snapshot (8.5.1-SNAPSHOT). Maybe I branched off unpulled master. However, I do not see this difference reflected here under Files changed. Should I merge master into my branch to fix this? I am a little confused.

AFAICT this branched from master just before 8.5.1 was released.  There are no problems when I merge locally.  We've probably just been working on non-intersecting parts of the code.  I don't think there is need to merge master into this branch without merge conflicts.

@kwalcock thanks for checking!

@kwalcock @MihaiSurdeanu fyi, converting this to draft for now. I am going through habitus tests to see what else needs fixed and whether these changes help in habitus, and I keep finding more things to do.

@MihaiSurdeanu I think I am done with this for now. Please have a look.
One concern I have is this commit https://github.com/clulab/processors/pull/649/commits/2b935c669f70f8b953949da68f3fbe4ae99a786d
The intention was to avoid finding in in released as Sahel 108 in Senegal in 1994 as a unit (inch). My previous solution of just disallowing units before NNPs did not work because fertilizers in habitus are frequently tagged as NNP. I also can't add a constraint to the rule based on location entity because based on what I can tell from the code, entities like locations are not available at the stage of numerical info extraction. My solution, though, feels to be a bit overkill. Any suggestions? If not, keep my solution or let it go with this example?

Hi @maxaalexeeva,
Yes, that commit is problematic. Would it be simpler to disallow units if the POS tag is "IN" or "TO"? Assuming the POS tagger is correct, this should fix the "in Senegal" bug because "in" there should be a preposition.
I think the question is: does the POS tagger label units as IN in legit cases?
Thanks!

@MihaiSurdeanu if I remember correctly, in(ch) got tagged as IN as well, but I'll double check tomorrow.

I see...
Then I don't have a better solution. Please merge it as is, @maxaalexeeva or @kwalcock.
Thanks!

@kwalcock I don't think I have the power to merge, so feel free to merge if you have no further comments!

Will do.


Modbus Flex Getter indicates a "active/connected" state but first modbus message lost.

I'm submitting a problem.
Problem
Current behavior
The Modbus Flex Getter node indicates an "active/connected" state via node status. I trigger this state to ensure that everything is fine. If I start sending a message the state changes to "queueing", ("failure"), "reconnecting", "initialize" and then again changes to "connected". The message which I tried to send is gone and will be lost. If I now start again  shortly afterwards (20sec or less) to send a message, the state changes from "connected" to "queueing", "reading done" and  "active" and the message has been send.
I am loosing every time the first message. In the logs there is sometimes a  "Modbus Failure On State sending Get More About It By Logging" or/and "PortNotOpenError: Port Not Open" error during the first message send. The question is: How can I avoid this lost of the first message?
My current workaround is a permanent read request to the modbus server every 10 seconds. The getter node is all the time in an "active" status. But this provides traffic and also do not avoid this behavior, if the connection breaks.
Expected behavior
The user should be able to check if the modbus connection is really initiliazed and ready for sending data. The "active/connected" state is not valid all the time.
Minimal reproduction of the problem with instructions

Request data from a modbus server by using a Modbus Flex Getter

Your Environment

(x) I am using just the Node-RED package with node-red-contrib-modbus

Device :

(x) Linux, nodered docker container

Description of the connecting Modbus system:

Name   : Modbus Server as a part of the SPPA-T3000 Control System
Version:  7.4 SP1
Vendor : Siemens Energy
Link   : https://new.siemens.com/global/en/products/automation/distributed-control-system/sppa-t3000.html

node-red-contrib-modbus version: v5.13.3

Node:  v12.18.3

Hi, please attach a log file - based on our Wiki about Debug logging - including the modbus-serial logs!
With that we should see the Modbus failures, too. ;)

@biancode Thank you for your answer.
Unfortunately, I have no access to a console. The environment is locked, node-red running in a docker container, I have no access to it. Are there any options to enable the debug information directly in node-red ui as starting point?

I can report I've found this same issue in the modbus-flex-write node (v5.13.3). Unfortunately i'm in the same boat (docker container) and can't debug either.
All i can get from the docker logs is:

13 Dec 21:34:56 - [warn] [modbus-write:AC Command] Modbus Failure On State sending Get More About It By Logging
13 Dec 21:34:56 - [warn] [modbus-write:AC Command] Modbus Failure On State sending Get More About It By Logging
13 Dec 21:34:56 - [warn] [modbus-flex-write:2b67ecb4.eed904] Modbus Failure On State sending Get More About It By Logging
13 Dec 21:34:56 - [error] [modbus-flex-write:2b67ecb4.eed904] Port Not Open

Seems to me like the remote device closes the socket but the local node still thinks it's open. After the first attempt the socket reopens and any subsequent attempts work as intended. I can confirm too that having a Modbus-read node polling the server is a workarround.
Maybe the flex nodes need some kind of 'heartbeat' to keep the socket open.

Hi you can set Docker env variables to activate the DEBUG global or you could set envs from the scripts to get more debug logs see the Wiki here about your options to set DEBUG. NODE_DEBUG should work as well via env settings to Docker ;)

That is more in the context of the user not on the nodes from my side. active means it should be ready, from what the nodes can check so far. If the is not enough, then it is out of scope here. You can use the status node of node-red to take care about it a bit more, but at the end there is no real proof in all cases. The message which you tried to send is gone and will be lost, but you get informed by errors and you can handle those errors on your side. There are to much possibilities to take care about all those cases. ;)


Possibly erroneous PAL_ASSERT

Hi,
When running AMDVLK driver on debug mode I get the following message:
AMD-PAL: Error: Assertion failed: pInfo->interpolatorCount >= 1 | Reason: Unknown (/some/path/drivers/pal/src/core/hw/gfxip/gfx6/gfx6PipelineChunkVsPs.cpp:124:EarlyInit)
I get this message on pipelines that are mainly used in shadowpasses. Those pipelines are not expected to have any varyings (I guess that's what you call interpolators). Maybe the assertion is incorrect.

This assert might caught a misbehavior in LLPC. A fix will be available soon.

Thanks. If you want a repro-case let me know.

@godlikepanos , could you please help to check with the latest amdvlk to see if this issue is gone?

Hi. Sorry for the late update. Haven't observed the issue latelly. Closing.


Add GHA for TM Integration Tests

What does this PR (Pull Request) do?

[x] This PR is not related to any Issue.

Which Traffic Control components are affected by this PR?

CI tests

What is the best way to verify this PR?
Look at GHA, make a branch and push to test run.

The following criteria are ALL met by this PR

[x] This PR includes tests OR I have explained why tests are unnecessary
[x] This PR includes documentation OR I have explained why documentation is unnecessary
[x] This PR includes an update to CHANGELOG.md OR such an update is not necessary
[x] This PR includes any and all required license headers
[x] This PR DOES NOT FIX A SERIOUS SECURITY VULNERABILITY (see the Apache Software Foundation's security guidelines for details)

Fixed the jq command so those warnings aren't output.


line indicators

Could honestly just put a badge on or before the name, with "#1" or something

not even a badge maybe just ${position}. ${displayName}


UnhandledException: System.TypeInitializationException: The type initializer for 'DlibDotNet.NativeMethods' threw an exception.

I get the references by nuget package, the DlibDotNet version is <IP_ADDRESS>20724.It works well on my machine, my os is win10,64 bit, the cpu is intel core i7-7700 cpu. The Target framework of my program is .net core 3.1. The program was published as
independent ,both win-x86 and win-x64. On my machine, the win-86 and win-x64 can work well. When I deploy the program on server ,the error  appears as follow:
UnhandledException: System.TypeInitializationException: The type initializer for 'DlibDotNet.NativeMethods' threw an exception.
---> System.DllNotFoundException: Unable to load DLL 'DlibDotNetNativeDnn' or one of its dependencies: 找不到指定的模块。 (0x8007007E)
at DlibDotNet.NativeMethods.LossMetric_anet_type_create()
at DlibDotNet.NativeMethods..cctor()
--- End of inner exception stack trace ---
at DlibDotNet.NativeMethods.get_frontal_face_detector()
at DlibDotNet.Dlib.GetFrontalFaceDetector()
The cpu of my server is Intel(R) Xeon(R) Platinum 8163,the  os is Microsoft Windows Server 2019 Datacenter.I have tried both  win-x86 and win-x64,the problem exist.
I have scanned the related issues like #172, the nuget package was setted to  v<IP_ADDRESS>90813, the problem still exist.
Please let me know how i can correct this
Thanks

sorry, I set the package to  v<IP_ADDRESS>90813  is another problem , and I have solved this by referencing to #136 on my machine,x64 works well,but on my server the problem still exist.

@maoshanli
Please clarify problem you face.

Why did you install old nuget package? You should use latest package unless you use legacy cpu machine

And you need not install DlibDotNet manually.

0x8007007E may be caused by https://github.com/takuya-takeuchi/FaceRecognitionDotNet/issues/47 or https://github.com/takuya-takeuchi/FaceRecognitionDotNet/issues/122


Add output option for kubectl

So users can decide if they prefer YAML snippets, or want to hand off config patching to kubectl.

I was thinking about making the same PR!

Actually, it would be nice to collect the output into a file, instead of stdout, optionally.

Thanks for the PR, closing in favor of #8


ol - filter by skill

@sradu wondering if you can take a look at this and I am wondering why the style is showing up for the button

@sradu added project types tagging and filters as well.
just can not get the styling  right

The new styling is up. @sradu please review

done @sradu. FYI, you need to do bundle install


Everlasting running runs, doing nothing

https://cl.aydo2.com/ays81/ays81/Runs?repo=/optvar/cockpit_repos/yves2

And when clicking one of them I get this:

Fixed in latest sandbox, according to @zaibon
@yveskerwyn  can you close this when validated?

No, not fixed
I just had a successful run, creating a new VDC, but in the Cockpit Portal it still shows as "running":

It is fixed, problem is purely wrong info in the Cockpit Portal, the above screenshot is from a run of 8 november (yesterday), back then we didn't have a repo yet with name "yves3"...
The real problem is this: https://github.com/Jumpscale/jscockpit/issues/230
Will close


add common tags to meters instead of changing the provided registry

After #4487 an embedded broker is overriding the tagging configuration of all metrics exposed by the embedding application.
Only meters created by the broker should add broker tags

@fogninid, the underlying problem here is not clear to me. Do you have a test that demonstrates the problem and validates the proposed fix?
The io.micrometer.core.instrument.MeterRegistry.Config#commonTags(java.lang.String...) method is being invoked on a specific instance of MeterRegistry. I wouldn't expect the configuration of one MeterRegistry instance to impact another. Is your application using this same MeterRegistry instance or its own?

See the linked repo. I am forwarding the (composite) meterRegistry created by spring-boot to the embedded broker.
I am not sure how you mean to create a separate registry only for the broker: I would not know how integrate it with the actuators of spring-boot.

@fogninid, thanks for the demo. I understand your use-case now. It's not something I imagined folks would be doing, but it makes sense.
I need to think about a way to write a test for this in the ActiveMQ Artemis test-suite...

I think your solution is solid. Check out PR #5230. I update the commit message and added another commit with a test plus a bit of polishing.

Thanks @jbertram for the quick feedback and polishing it!


Customizing allowed tags in cleanHTML

Hello,
I am trying to filter pasted text to keep only a specific set of tags, and to offer the option to paste as plain text.
I saw that there is a whitelist of tags here, which is used when cleaning the pastedHTML:
https://github.com/JiHong88/SunEditor/blob/master/src/lib/util.js#L1080
It would be great if it was possible to influence this list somehow.
Alternatively, it would be great if we could modify the cleaned HTML before it is pasted. The onPaste event only allows cancelling the event, not modifying the HTML.
What do you think, would something like that be possible, or is there an existing way that I overlooked?

Hi @Mistralys
The whitelist is a list of tags that the editor allows.
Do you need the ability to keep certain tags only when pasting?
This means that the tags allowed by the editor and the tags allowed when pasting are different.

Hi @JiHong88,
yes, I want to keep only specific tags when pasting. You are right, that's different from the tags the editor allows, which do not necessarily have to be the same set of tags.
What I am trying to do with a whitelist when pasting is this:

Keep only specific tags when pasting (for example only  tags)
Be able to paste as plain text (possibly with an empty whitelist)

Ideally, it should be possible to change the whitelist on the fly, which I could easily implement if the onPaste event allowed modifying the HTML.
What do you think?
And thanks for the reply :)

Yes I can make related options.
Does making an immediate change mean making end user to change?

Hi JiHong88,
thanks, that would be great!
What do you mean with the immediate change for end users?

No sorry, forget it.
I don't have enough English.
I'll update it by adding related options.

Awesome, thanks a lot! Looks good :)

The 2.26.0 version has been updated.
If there is an issue, please register as a new issue.
Thank you.


Readme: Add AppVeyor badge

Adding a badge for the AppVeyor build. Also testing to make sure AppVeyor picks up PRs.
It looks like AppVeyor hosts the project under the account name, which in this case is my username, so the CI url is: https://ci.appveyor.com/project/trentmwillis/qunit. Is there or should we set up a "jquery" account so that the URL can look more correct? If so, who can do that?

So looks like AppVeyor doesn't have great support for projects owned by GitHub orgs (relevant article).
@stefanpenner do you have any insight on how Ember-CLI handles this? Did you just set up an extra account?

I set up an ember-cli account

Okay, cool. Thanks for that info.
@leobalter can you set up a jquery or qunit account that we can use?

It is also running on https://ci.appveyor.com/project/leobalter/qunit. (at least the hook is set to my acc) :P
The link should be https://ci.appveyor.com/project/jquery/qunit. I don't know if someone else at the jQuery Foundation handled it. I couldn't find it being used on other projects from the org (Mobile, UI, Globalize, PEP, etc).
I'll ping @jzaefferer as he might have access to a jQuery org-acc. Meanwhile, let's keep it as it is now. This should not prevent this PR from being merged (LGTM), we may change the badge url later and the badge result is based on the last build regardless the acc.

Sounds good. I'll let you handle that. Meanwhile I'll update the badge link to point to your account (since it looks like it took precedence from mine) and then merge this.


[Help Wanted] Reopen Apps for Boot Not Current Apps

Use this list instead.

@Kyle-Ye !!!

I am not really familiar with "Login Items". So I'm not sure I can help with this.


[BUG]: Function components cannot be given refs. Attempts to access this ref will fail. Did you mean to use React.forwardRef()?

Describe the bug
This is a internal bug from library that is related to refs, here's an error:
Warning: Function components cannot be given refs. Attempts to access this ref will fail. Did you mean to use React.forwardRef()?

Check the render method of 'SlotClone'.
    at RichTextArea (...)

To Reproduce
Create some components from the demo, mentions etc
Expected behavior
The warning should be resolved
Platform:

OS: [Windows, MacOS, Linux, Android, iOS]
Browser: [Chrome, Firefox, Safari, Edge]
Version of this package: ^0.26.2

Additional context
Not available

Could you make a minimal reproduction? It's not reproduced.


Global event unbinding breaks other plugins

In this line (and some other), event listener is unbind in this way:
$document.off('mousemove');

The problem is that it removes all the listener on the page and so, it can break other plugins using this event.
 The problem is that the only other way not to unbind globally is to unbind providing the bound function. But this is more constraining and not always possible!
Still this is a problem since it brokers other plugins, such as Highcharts.
Moreover, there are memory leak issues due to other listeners that are not unbound on scope destroy (a recent commit added unbindings on document destroy but some events are missing and document is not enough since we are doing SPA). I was planning to do a PR but it uses namespacing...

@ValentinH with 703ad38 I have changed the way the binding / unbinding work. Can you take a look if the memory leak problem has been solved?

I just made a test with that last version and I still have leaks problems. I'm checking what is missing compared to the modifications I made to fix them and I'll submit a PR.

I found the issue, it is the unbinding on the window that misses an argument.
angular.element($window).off(calcDimFn);

should be replaced by
angular.element($window).off('resize', calcDimFn);

Another remark: regarding the memory leaks issues, my tests have shown that the only important
unbindings are the one on document and window. So in my opinion, the code for the destroy event should simply be:
this.scope.$on('$destroy', function() {
    angular.element($window).off('resize', calcDimFn);
});

Indeed, the binding on the scope and on the element (and its children) of the directive are managed by angular: http://stackoverflow.com/questions/26983696/angularjs-does-destroy-remove-event-listeners

The weird thing is when I do two JS Heap snapshots in Chrome i see that the memory used is still increased.

What is your test scenario?
Mine was to navigate between two views, A and B where A contains a slider. Once on B, the all scope of A was still in memory in the previous version due to the leaks in angular-slider. Now, the A scope is correctly deleted when navigating to B.

Using Chrome

Load the demo site
Take heap snapshot
Play with slider handles for a few seconds
Wait 2 - 3 seconds
Take heap snapshot and compare to first one

Yeap I just tried this scenario and there are a few elements that are created  during the sliders manipulation but nothing important in my opinion.
If you take 3 snapshots and check the objects that are still in Snap 3 but created between 1 and 2, there are nothing big. More importantly, I don't see any DOM Element that are still here because attached to a Scope object. So, it is OK AFAIK.
In my application, before you fix the leaks, all the scope object was kept between each view so after a lot of page views the application was containing something like a hundred scopes in memory. Now it is fixed.

[Edit]: I have also read in several places that ensuring ourselves the unbinding was a good practice to prevent any bug. Indeed, in some rare cases, Angular might misses some unbinding so doing that ourselves is safer.

@ValentinH, would you mind show some example that angular misses some unbindings

Nope I don't. As I said it is only good practice, and use the term "might"... I don't have proof but it doesn't cost much to do it ourselves...

Yeah, i get it.
However, IMHO, part of the good coding style is to keep the code clean and do the necessary thing. Since we develop something based on angular which itself does a great job most of time, and there is no evidence of that problem/bug, we don't need to do that. Even if the bug exists, we should make an issue to angular, and we can do some hack/dirty work temporarily. Once the issue is fixed, we ought to go on the right way.
ehhh, just my opinion.

Are you talking about these unbindings: https://github.com/rzajac/angularjs-slider/blob/master/rzslider.js#L355-L358 .
I can retest the leaks when removing them on Monday but I think they were necessary...

https://github.com/rzajac/angularjs-slider/blob/master/rzslider.js#L325-L361
Nope, i'm taking about the deRegFuns and the unRegFn, what you have mentioned above of course they are necessary 'cause they won't be unbinded automatically

Oh I see, my comment was only referring to DOM event actually and the lines in my previous comment should be useless since this DOM element are created as children of the Directive and so will be deleted... I agree about the unbinding of watches, they are probably useless.


Set log_level to debug when rerunning a job with debugging

Not quite sure what variable needs to be read but based on prior experience and a quick glance at the docs this seems possible.

https://docs.github.com/en/actions/managing-workflow-runs-and-deployments/managing-workflow-runs/re-running-workflows-and-jobs
https://docs.github.com/en/actions/monitoring-and-troubleshooting-workflows/troubleshooting-workflows/enabling-debug-logging

Basically I am wishing that when a run fails and you use the "Re-run failed jobs" with "Enable debug logging" it would automatically always set the log_level to debug.

Doh, I should've tested the most recent change myself

Classic case of only testing the initial changes and not the ones getting merged.
Would love to write a test case for this but I have no idea how to do that... 🤔 Looks like debug mode can be enabled with an environment variable but is there a way to check the output in a nice way. 🤔


feat: openai api compatible model presets (profiles)

Is your feature request related to a problem? Please describe.
As the modelfiles from the hub are pretty good, it would be nice if we could use also them with external models from openAI api compatible services.
Describe the solution you'd like
Option A:
When adding a modelfile, we could check that it should use a model from the external provider and select it.
Option B:
When selecting a modelfile, we should be able to exchange then the actual model to one from the external service.
Describe alternatives you've considered
Setting the default prompt according to the modelfile works for now, just the profile pick and name is wrong and the extra settings.
Additional context
My ollama instance has limited vram available. External services can provide bigger models. I think it would be good if the same characters would be usable when using an external service.

Ollama.ai is not directly associated with this project. Your feature request belongs with them.

Thanks for taking a look. I already implemented this and it works for me. See the referenced PR.

OK first, thanks for adding features. It's awesome to have a community that's adding to a project.
Per the PR, I have some suggestions that I'll post over there.

Changed my mind, I'll post here:
Modelfiles are an Ollama.ai-specific feature to describe settings that belong to a specific model. OpenAI doesn't have such a thing because most of the provided functionality it is wrapped up in the product offering. Of course we live in a world where the OpenAI API is becoming the standard even for interacting with custom models and local LLM servers. That leaves a functionality hole that you're trying to address here.
However, I think the over-arching feature request (added metadata for non-local, non-ollama.ai models) needs to be thought of a bit more holistically. For example, in the UI, we set an Ollama server and optionally and OpenAI key and endpoint. the WebUI then gives you access to both.
I think the right way to solve this issue is to unify the idea of external LLM servers much like how LiteLLM handles it. (That and even Ollama.ai is working on adopting OpenAI's API.) Your PR provides metadata to all in an agnostic way but maintains the type-difference segregation.
The whole idea of multiple models/servers/configurations is tied up in other feature requests that should be considered since they all would (should?) share the same solution: https://github.com/ollama-webui/ollama-webui/issues/278 https://github.com/ollama-webui/ollama-webui/issues/619

I also feel like the Modelfile format is the wrong format for its purpose. It's patterned after Dockerfile (possibly since the ollama.ai author previously worked on docker). But Dockerfile is the way it is because each line represents a progression. This is not a thing in Modelfile. I feel like we should have our own custom file to manage this metadata. TOML or YAML (but I haven't put too much thought into it).

@explorigin I think you've put into words what I've been thinking over this and been unable to articulate. Modelfile is by and for Ollama and I'm really not sure just saying "adding OpenAI to it" and dusting our hands does the proper service to solving this problem.

Thanks guys for thinking about this.
Stepping but, here is what I actually wanted to achieve (with my patch I actually also achieved it):
To get a character for ollamahub but use it with an openAI API (in my case together.ai)
The main thing I wanted to have was the system prompt, I was not so much interested in the specific parameters.
And obviously the character name and profile picture.
So maybe the request is this:
Make ollamahub models also usable with openAI API compatible services, not just ollama.
What do you think?

Ollamahub is supposed to provide access to anything that the user can download via Ollama.ai...so allowing it to reference any custom model will likely lead to a bad user-experience if that model in question is not available. We certainly don't want modelfiles pointing to together.ai endpoints.
LMStudio references models by huggingface path (e.g. TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF). This feels like the right way to go w.r.t. applying specific settings to specific models. It's quantization-agnostic while remaining model-specific. Ollama.ai tries a little too hard to be docker with it's :latest tag that you have to chase hashes to find what that even means. But I digress:
So what we want is a sort of configuration file that:

applies to model regardless of source
sets custom prompts
provides a character name and profile pic
provides sensible defaults for given models

Anything else?
Definitely think we should consider what's in LMStudio's Model configuration dialog.

Absolutely, I concur with everything above. However, I believe it's crucial that we extend our exploration to the broader community to ensure we're not overlooking any existing generalized solutions to this problem that we could potentially endorse.

It's not a standard if it's not applied everywhere. 😁 #15 here we come!

TODO

[ ] Decouple modelfiles from Ollama
[ ] Save model preset to webui db directly

Implemented on our dev branch, please let us know if you encounter any issues!


Graylog - Update logo and link to Blog

Logo
Please upload a company logo
Additional image
Please delte the red /gray old image -- Just the logo please
Links
Add links to your last three blogs that are relevant for the OpenSearch Project audience.
Please remove the first link on Anomaly detection and replace with a link to https://opensearch.org/blog/navigating-the-future-of-log-management/

Thanks @GrayMary ! I'll drop the new logo in and replace the anomaly detection link.

@GrayMary : Do you have a thumbnail we can use for the blog link we're replacing? I'd hate to leave a big blank right here:

@GrayMary - our partners page usually renders best when we have a company logo that has a square aspect ratio. Do you have anything like that available?
Thanks!

@nateynateynate Let me go track one down Thanks

I just saw your comment about thumbnail -- I will get one.

Here is an intriguing navigation image --

Let me know if it works

@nateynateynate Hello - I am a contractor with Graylog and today is my last day -- so if you have a chance to complete that would be great. Thanks!


bower --save fails to update manifest when ANY install fails

bower version 1.3.3
node v0.10.26

I encountered this behavior was unexpected and is wondering if it is design choice or a true bug.
steps to reproduce:
bower install bluebird fakePackageName --save
bluebird is not saved to bower manifest
I expected bluebird to be written to the manifest file because it installed correctly but I was not notified that there was a failure
I'm not sure if this was a design choice but if it was how would you feel about adding a message to alert the user to the fact that noting was written to the manifest file.
Thank you for making this great tool.  I'm more than willing to implement a solution if it was a design choice.

@spinloop Hey man, what operating system are you using and this is also a duplicate of issue #1643

@mykhael i'm using OS X Yosemite 10.10.1
sorry about the duplication - i did a quick search through the open issues and didn't see it but obviously missed it

@spinloop no man you are fine, I do this all the time but I recommend commenting your problem on issue #1643 so that the bower developers change the tag from windows to bug because it's happening on more than one os. Also since this is a duplication, I recommend closing this issue.

So being new to this game I am not sure what I am to do?

bower install jquery --save
bower not-cached    git://github.com/jquery/jquery.git#*
bower resolve       git://github.com/jquery/jquery.git#*
bower download      https://github.com/jquery/jquery/archive/2.1.3.tar.gz
bower extract       jquery#* archive.tar.gz

It doesn't work. Suggestions?

Please prepare failing test, and submit it in PR.

@spinloop I checked it on Windows, and bluebird is not installed in bower components. bower install is supposed to be all or nothing, so it seems like correct behavior.

bower install query --save fails.


Getting error while installing on Ubuntu 20.04

Hi,
I am trying to install KITE on Ubuntu 20.04. During the Configure KITE step, getting below error. And KITE_HOME also not getting set
Do you want to start the Grid (y/n)?  y
./setupLocalGrid.sh: line 9: cd: /localGrid: No such file or directory
Setup completed.
./setupLocalGrid.sh: line 14: ./startGrid.sh: No such file or directory

I just happened to meet it. My solution is

vi /etc/profile
export KITE_ HOME = /opt /GitHub/KITE/   (your KITE path)
source /etc/profile
Re execute  . /configureLinux.sh

Hi,
Sorry for the late reply, I haven't had time to look into this yet. @gharia is the solution @ss7424Refar suggested working for you?

Hey @namvuCosmo,
Thanks for asking. I just tried @ss7424Refar suggested solution and I can confirm it worked perfectly fine. Thank you guys for helping. Closing this issue.


Update sonarr.py

added ability to track upcoming episodes (https://picload.org/image/dogapgwa/1.png)
slightly modified missing episodes to show additional data (episode name) also added leading 0 to reflect S00E00 format to help my OCD.
feel free to use what you like!

No preference on this


[E2E] generate unique names for PVC/PV and pod Names

With the current E2E it's difficult to identify the problem based on the PVC name or the pod name as we reuse the same name in multiple tests. It's good to generate a unique name each time which helps in debugging.

reopening, this is needed for better debugging in CI.


Getting one issue in USB host uvc support

@xiaocq2001 ,
I am working on USB host uvc support, usb devices as connecting to my target board are logitch camera and AIRHUG camera ,

With logitech camera it's working fine with resolution as follows below: 680480 with 30fps and 1280720 with 10fps,
but, if I use resolution as 1280*720 with 30fpsfps since usb camera device supports, it's not working and observed that there is no valid frames.
I could see that it's throwing RING OVERRUN_EVENT.
From the USB trace i have observed that when multi transactions per microframe scenorio it's not working, but its' working only when single transaction per microframe.
I have gone through the usbx host video class code and understand that at time only one payload is requesting to the usb camera device, this should be fine only when single tracsactions per microframe but, I believe that when we increase the resolution and framerate, we have to request mutilple payloads at time.

Please let me know if my understanding is correct, also could you please suggest that how we can request mutilple payloads at time from the application.
Regards
Mahesh

Hi @xiaocq2001,@yuxin-azrtos,
Any update on above comment.

ux_host_class_video_transfer_buffers_add adds a list of buffers before transfer start, each buffer is for a video payload including 1 to 3 transactions. When a buffer is sent callback set by ux_host_class_video_transfer_callback_set is called, to append a new buffer to end of the list. In this way certain number of buffers are "cached" for sending.
Multiple transactions per microframe is usually supported by controller driver, to allow controller endpoint to filled in multiple banks, or FIFO filled by 1~3 transactions bytes, or filled by DMA by 1~3 transaction bytes, if the controller driver is not modified to fit the multiple transactions transfer support that is not working.
Maybe you can check if your hardware (controller) can support multiple transactions per microframe and if your controller driver implements code to support this function.

ux_host_class_video_transfer_buffers_add adds a list of buffers before transfer start, each buffer is for a video payload including 1 to 3 transactions. When a buffer is sent callback set by ux_host_class_video_transfer_callback_set is called, to append a new buffer to end of the list. In this way certain number of buffers are "cached" for sending.

Yes, it's correct, you mean that same application will work for single transaction per microframe and multi transactions(1 - 3) per also, we no need to prepare multiple buffers at time for multi transactions per microframe.
I really appriciate your help on this.
Regards
Mahesh


[TASK] Flash of uninitialized when you create a new row

Estimated story points: 5
Description

Acceptance criteria

time: 1h


Touch Effects: what to do about keyboard support for touch demo?

https://developer.microsoft.com/en-us/microsoft-edge/testdrive/demos/toucheffects/
One can use mouse or touch to move the dots around. However, keyboard doesn't work. Not sure even how this should work with keyboard. Not sure if this should be exempt as it is a multi touch demo.

@dstorey this is a touch demo. It doesn't make sense to use keyboard...

@molant it is, but still needs to pass unless can get an exception. I think this is the easiest to justify. I think it is mostly that it is badly designed, in that if we want to teach touch for real developers, it should be an experience that falls back for other input like mouse any keyboard, so not teaching bad practices. In this case the only thing I can think of is treating the page like a grid were you can tab between different cells and make the dots move there as if it was touched. But that is probably fairly hard as would need a bunch of hidden buttons or whatever, and no idea what the screen reader would be for that.


Support Go 1.6 vendoring

Godep now supports the vendor/ dir. This enhancement would move dependencies from Godeps/_workspace/src to vendor, allowing the project to be built without installing godep. This is probably a good opportunity to move functionality from tools in bin/ to a Makefile.

Fixed at #7.


Add support for selective AR objects

See Issue #47
Added support for SceneModels to be included as part of AR
Added support for optional AR object types that are enabled/disabled via the Plattar CMS
NOTE: Adding SceneModels suddenly to Scene AR may cause regressions, added critical change card against

Testing

Test Scenes with SceneModels and SceneProducts (all enabled)
Test Scenes with SceneModels and SceneProducts (all disabled)
Test Scenes with only SceneModels
Test Scenes with only SceneProducts
Test Scenes with SceneModels and SceneProducts (randomly enabled/disabled)


word sign password

hi! aw.digitalsignatures.CertificateHolder.create(MY_DIR + "morzal.pfx", "aw")   on windows system no problem!but complex password can't decrypt on unix like centos， only “aw”!
你好！word文档加密电子签名设置的密码基本在windows系统没问题，但是在类unix系统 如centos7 只能(猜测)使用aw.digitalsignatures.CertificateHolder.create(MY_DIR + "morzal.pfx", "aw") aw为密码  其它如123456/nihao/nihao123等等都不能用！请问是什么原因？提示RuntimeError: Proxy error(InvalidCastException) or other tips

@zhongsdjn If you use the PFX file from the examples repository for testing, then you must use aw password. This is the password to access certificate data. If you pass other password, you will get exception like this:
PKCS12 key store MAC invalid - wrong password or corrupted file.
Could you please provide a full error message you get or if possible sample PFX file? We will further investigate the issue and provide you more information.
I tried using another PFX file on my side with<PHONE_NUMBER> password and it works fine.

No feedback and cannot reproduce. Close.


CI_* variable deprecation

@bmeneg @zampierilucas
https://docs.gitlab.com/ee/update/deprecations#ci_build_-predefined-variables
Just an FYI.  We need to think about this.

I don't think it's a problem to us today: we don't use any of the CI_BUILD_* variables. We're already using vars with the up-to-date name, i.e. CI_JOB_TOKEN.


"Next" button should be below a form fields

In the challenge creation process, the "Next" button is on top, so after filling all the fields I had to scroll to top to press it. Can you move the button to the bottom? The same for the "Complete" button, I guess.

This looks to be addressed as the buttons are on the bottom now.


After recent update cannot connect to IBM I

After I received an update and restarted
I cannot see the systems that I have entered on the configuration

I click the button nothing happens

Am currently investigating this issue too!
After you launch VS Code, go to Help->Toggle Developer Tools, can you paste the output here?

I hope this screenshot will help. It's on my work computer.
From: barry @.>
Sent: February 2, 2023 7:53 AM
To: halcyon-tech/vscode-ibmi @.>
Cc: GordonFenske @.>; Author @.>
Subject: Re: [halcyon-tech/vscode-ibmi] After recent update cannot connect to IBM I (Issue #1039)
Am currently investigating this issue too!
After you launch VS Code, go to Help->Toggle Developer Tools, can you paste the output here?
—
Reply to this email directly,  https://github.com/halcyon-tech/vscode-ibmi/issues/1039#issuecomment-1413869097 view it on GitHub, or  https://github.com/notifications/unsubscribe-auth/A5UFLNVUQWD27ZWNDYNXQRLWVPC5PANCNFSM6AAAAAAUPD24EI unsubscribe.
You are receiving this because you authored the thread.  https://github.com/notifications/beacon/A5UFLNU2MBDIR2HGURDCM7TWVPC5PA5CNFSM6AAAAAAUPD24EKWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTSUIXXCS.gif Message ID: < @.> @.>

@GordonFenske Screenshots cannot be uploaded through emails. Please upload it on the GitHub issue itself.
Thanks.

Here is the Console screenshot.

Ok very good... By the way I like what you are doing...

@GordonFenske Thank you! I am re-opening this until the bug is released.

@GordonFenske 1.6.15 is out which will solve this issue!

Works fine now.. Thanks
From: barry @.>
Sent: February 2, 2023 9:59 AM
To: halcyon-tech/vscode-ibmi @.>
Cc: GordonFenske @.>; Mention @.>
Subject: Re: [halcyon-tech/vscode-ibmi] After recent update cannot connect to IBM I (Issue #1039)
@GordonFenske https://github.com/GordonFenske  1.6.15 is out which will solve this issue!
—
Reply to this email directly, view it on GitHub https://github.com/halcyon-tech/vscode-ibmi/issues/1039#issuecomment-1414066082 , or unsubscribe https://github.com/notifications/unsubscribe-auth/A5UFLNQIWNDZVKWYVI7OGJTWVPRVVANCNFSM6AAAAAAUPD24EI .
You are receiving this because you were mentioned.  https://github.com/notifications/beacon/A5UFLNTJYKWSW7Y6URMJYQLWVPRVVA5CNFSM6AAAAAAUPD24EKWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTSUJDX2E.gif Message ID: @.*** @.***> >


Bugfix/dle 937 download dataset once

don't merge - I want to run tests on the tzag

Im closing this PR for now as it has been stale for a while and our code already supports most of the functionality discussed above, will open a tech dept for this issue.


Update aiofreepybox to fix HTTPS connection issues

Description:
The previous version of aiofreepybox was not working with custom domain names, which use a Let's Encrypt certificates. Also, it was not working with the default domain name when connecting to Freebox v6. This should be fixed in aiofreepybox 0.0.4.
See https://github.com/stilllman/freepybox/pull/1, https://github.com/stilllman/freepybox/pull/3 and https://github.com/stilllman/freepybox/issues/2 for more info.
Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with tox. Your PR cannot be merged unless tests pass

If the code communicates with devices, web services, or third-party tools:

[x] New dependencies have been added to the REQUIREMENTS variable ([example][ex-requir]).
[x] New or updated dependencies have been added to requirements_all.txt by running script/gen_requirements_all.py.

Thanks!


Regex Error at generating output files step

I'm getting this error on both 0.12.7 and 4.0. with jsdoc version 3.3.3
The parsing completes with no problems, but on the last step I get this error, but I'm having trouble narrowing down the cause. Any help would be greatly appreciated.
DEBUG: Finished parsing source files.
DEBUG: Indexing doclets...
DEBUG: Adding inherited symbols, mixins, and interface implementations...
DEBUG: Adding borrowed doclets...
DEBUG: Post-processing complete.
Generating output files...undefined:19
            paramRegExp = new RegExp('^(?:' + parentParam.name + '(?:\\[\\])*)\\.(.+)$');
                          ^

SyntaxError: Invalid regular expression: /^(?:func(parentKey,(?:\[\])*)\.(.+)$/: Unterminated group
    at new RegExp (native)
    at eval (eval at <anonymous> (D:\THEPATH\node_modules\underscore\underscore.js:1329:20), <anonymous>:19:27)
    at Array.forEach (native)
    at eval (eval at <anonymous> (D:\THEPATH\node_modules\underscore\underscore.js:1329:20), <anonymous>:11:12)
    at template (D:\THEPATH\node_modules\underscore\underscore.js:1336:21)
    at exports.Template.partial (D:\THEPATH\node_modules\jsdoc\lib\jsdoc\template.js:60:29)
    at eval (eval at <anonymous> (D:\THEPATH\node_modules\underscore\underscore.js:1329:20), <anonymous>:56:14)
    at template (D:\THEPATH\node_modules\underscore\underscore.js:1336:21)
    at exports.Template.partial (D:\THEPATH\node_modules\jsdoc\lib\jsdoc\template.js:60:29)
    at eval (eval at <anonymous> (D:\THEPATH\node_modules\underscore\underscore.js:1329:20), <anonymous>:204:14)

Figured it out:
The following line was responsible:
 @param func(parentKey, parentObj, key, value) {function} visitor function that takes parentKey,     parentObj, key, and value

That's a severely malformed @param tag, so you shouldn't expect it to generate reasonable output. But I agree that JSDoc shouldn't crash in this case.


@conda-forge-admin, please add noarch: python

Additional comment:
No response

Hi! This is the friendly automated conda-forge-webservice.
I just wanted to let you know that I made the recipe noarch: python in conda-forge/gpaw-data-feedstock#3.


CUDNN Support

Feature Request - add option gpu_backend='cudnn' to use CUDNN to replace torch-rnn LSTM layers with their CUDNN implementation. Currently testing in private fork, but would appreciate insight about its use as a drop-in replacement.

I agree that this is a good feature, and it would be relatively easy to add.
The complication is that cuDNN layers can only be used on GPU. Even if you use a GPU for training, the saved checkpoints should be runnable on a machine without a GPU; that's why the training script casts to float before saving checkpoints. To keep this same behavior with cuDNN, we really need functionality to convert back and forth between cuDNN layers and torch-rnn layers; this is certainly doable but a bit more annoying.
This has been something that I have been meaning to do for a while, but haven't gotten around to it yet.

Yeah, that has been something I've been wrestling with myself. What I was envisioning is just enabling it as a gpu-only option and labeling it as such. I don't know how familiar you are with cuDNN, but one thing I am experiencing in my drop-in replacement is while the "batch first" option should be enabled on the cuDNN LSTM layers (the input is batch x time x dim, if I'm not mistaken), that causes an error when inputting to the View that replaces the temporal convolution layer. Only if that option is set to false does it not give an error.

Found a fork here: https://github.com/ngimel/torch-rnn that seems to fix my problems. It seems like there is an active issue within cudnn that deals with converting back to a CPU layer, so it seems like you are not the only one to think so.


Issue 85

This includes changes in issue-45 and issue-67

See issue 85

I would add only this fix (https://github.com/pgilad/leasot/pull/89/commits/f820c19e8cfb3d589db01f526285e120ba0145e8) to this PR, perhaps also with the UT fix

Yeah sorry the pull requests and history got a little messy, but I needed the fixed from the other 2 PR to be able to test on my windows machine. Once PR 87 and 88 go in then this will only contain the commits related to the feature ( f820c19 and 808fd8bad)

Thanks a lot @SeanSobey I manually merged this code - see https://github.com/pgilad/leasot/commit/cb765bc2cae89c7afb064438cf12558e243a1745


Private tenants not available for indexes with FGAC domains[DOC]

What do you want to do?

[ ] Request a change to existing documentation
[x] Add new documentation
[ ] Report a technical problem with the documentation
[ ] Other

Tell us about your request.
Add note to the server_username setting in config.yml to alert users that when they change from the default kibanaserver the system drops the indices:admin/index_template* permissions, which leads to missing private tenants.
What other resources are available?
Based on Security Dashboards PR #1418.

@hdhalter I can take this one

PR raised https://github.com/opensearch-project/documentation-website/pull/7066


Use FocalLoss from fvcore

As mentioned https://github.com/luca-medeiros/lightning-sam/issues/16#issuecomment-1541319552 here, the current focal loss is not consistent with fvcore one.
Re-implementing and running tests would be needed.

Probably we could refer to sigmoid_focal_loss on huggingface/transformers.


[Bug] Camera initialization fails on Google Pixel 2XL

Description
Steps to Reproduce

Create an Xamarin.Froms App with CameraView
Execute the app on Pixel 2 XL (real) device
Camera will be never initialized

Expected Behavior
Camera is initialized and ready to to use (with preview).
Actual Behavior
Blank screen. Shutter action ends in an exception.
Basic Information

Version with issue: 1.0.0-pre6
Last known good version: unknown
IDE: VS 2019 (16.8.3)
Platform Target Frameworks:

iOS:  not tested
Android: API 30

Android Support Library Version:
Nuget Packages:

Xamarin.Forms: <IP_ADDRESS>9-pre6
Xamarin.Essentials: 1.6.1-preview1
Xamarin.FFImageLoading.Forms: <IP_ADDRESS>2
Syncfusion.Xamarin: <IP_ADDRESS>

Affected Devices: Google Pixel 2 XL

Workaround
Not known. The same code works in Emulator, but not on device.
Reproduction imagery
Log from VS:
01-05 08:07:13.446 I/.burstphoto.po(26799): Explicit concurrent copying GC freed 10014(687KB) AllocSpace objects, 0(0B) LOS objects, 49% free, 2784KB/5568KB, paused 40us total 10.112ms
01-05 08:07:13.448 D/Mono    (26799): GC_TAR_BRIDGE bridges 370 objects 3528 opaque 1050 colors 371 colors-bridged 370 colors-visible 370 xref 34 cache-hit 0 cache-semihit 0 cache-miss 1 setup 0.03ms tarjan 1.33ms scc-setup 0.06ms gather-xref 0.03ms xref-setup 0.00ms cleanup 0.44ms
01-05 08:07:13.448 D/Mono    (26799): GC_BRIDGE: Complete, was running for 13.13ms
01-05 08:07:13.448 D/Mono    (26799): GC_MINOR: (Nursery full) time 9.30ms, stw 9.81ms promoted 1448K major size: 2560K in use: 1830K los size: 2048K in use: 1100K
Thread started:  #20
Thread started:  #21
01-05 08:07:13.679 W/CameraDevice-JV-0(26799): Stream configuration failed due to: endConfigure:505: Camera 0: Unsupported set of inputs/outputs provided
01-05 08:07:13.679 E/CameraCaptureSession(26799): Session 0: Failed to create capture session; configuration failed

Log over Logcal (Android Studio):
2021-01-05 08:07:52.529 26799-26799/rsag.burstphoto.poc W/CameraDevice-JV-0: Stream configuration failed due to: endConfigure:505: Camera 0: Unsupported set of inputs/outputs provided
2021-01-05 08:07:52.529 26799-26799/rsag.burstphoto.poc E/CameraCaptureSession: Session 0: Failed to create capture session; configuration failed

Reproduction Link

RSAG.BurstPhoto.PoC-Community.zip

Thanks for the report @WebDucer !
You mention Google Pixel 2XL specifically, have you been able to test it on other devices besides the emulator? Is this indeed very specific to this device? Or is this simply the device you have tested on?
From the error messages it seems something is. wrong with something we try to configure?

Thanks for the report @WebDucer !
You mention Google Pixel 2XL specifically, have you been able to test it on other devices besides the emulator? Is this indeed very specific to this device? Or is this simply the device you have tested on?
From the error messages it seems something is. wrong with something we try to configure?

@jfversluis Currently I have only access to my personal Pixel 2 XL as a real device. Next week I will be able to test the behaviour with some other devices if needed.

From the error messages it seems something is. wrong with something we try to configure?

I found only on StackOverflow (https://stackoverflow.com/a/47041696/1271756) that this happen, if the preview resolution is too big (4k) and not sized correctly to the canvas size.

@jfversluis Currently I have only access to my personal Pixel 2 XL as a real device. Next week I will be able to test the behaviour with some other devices if needed.

From the error messages it seems something is. wrong with something we try to configure?

I found only on StackOverflow (https://stackoverflow.com/a/47041696/1271756) that this happen, if the preview resolution is too big (4k) and not sized correctly to the canvas size.

The maximum preview size allowed by Camera2 must be taken into account, especially in the ChooseOptimalSize method
// Max preview width that is guaranteed by Camera2 API
public static readonly int MAX_PREVIEW_WIDTH = 1920;
// Max preview height that is guaranteed by Camera2 API
public static readonly int MAX_PREVIEW_HEIGHT = 1080;
I leave you a part of my implementation that works, I have also had that error and I fixed it. It’s not very tidy, I’m sorry
Camera2.zip
`
private static Android.Util.Size ChooseOptimalSize(Android.Util.Size[] choices, int textureViewWidth,
int textureViewHeight, int maxWidth, int maxHeight, Android.Util.Size aspectRatio)
{
// Collect the supported resolutions that are at least as big as the preview Surface
var bigEnough = new List<Android.Util.Size>();
// Collect the supported resolutions that are smaller than the preview Surface
var notBigEnough = new List<Android.Util.Size>();
        float w = aspectRatio.Width;
        float h = aspectRatio.Height;
        float hw = h / w;

        // for (var i = 0; i < choices.Length; i++)
        foreach (var size in choices)
        {

            Android.Util.Size option = size;
            if ((option.Width <= maxWidth) && (option.Height <= maxHeight) &&
                    option.Height == option.Width * hw)

            {
                if (option.Width >= textureViewWidth &&
                    option.Height >= textureViewHeight)
                {
                    bigEnough.Add(option);
                }
                else
                {
                    notBigEnough.Add(option);
                }
            }
        }

        var sizeLinq = choices.Where(q => (q.Height * q.Width) <= (maxHeight * maxWidth)).OrderByDescending(element => element.Width * element.Height).FirstOrDefault();
        // Pick the smallest of those big enough. If there is no one big enough, pick the
        // largest of those not big enough.
        if (bigEnough.Count > 0)
        {
            return (Android.Util.Size)Collections.Min(bigEnough, new CompareSizesByArea());
        }
        //else if (sizeLinq != null)
        //{
        //    return sizeLinq;
        //}
        else if (notBigEnough.Count > 0)
        {
            return (Android.Util.Size)Collections.Max(notBigEnough, new CompareSizesByArea());
        }
        else
        {

            Log.Error(TAG, "Couldn't find any suitable preview size");
            return sizeLinq;
            //return choices.Where(q=>(q.Height * q.Width) <= (maxHeight* maxWidth)).OrderByDescending(element => element.Width * element.Height).First();
            // return choices[0];
        }
     }`

The maximum preview size allowed by Camera2 must be taken into account, especially in the ChooseOptimalSize method
// Max preview width that is guaranteed by Camera2 API
public static readonly int MAX_PREVIEW_WIDTH = 1920;
// Max preview height that is guaranteed by Camera2 API
public static readonly int MAX_PREVIEW_HEIGHT = 1080;
I leave you a part of my implementation that works, I have also had that error and I fixed it. It’s not very tidy, I’m sorry
Camera2.zip
`
private static Android.Util.Size ChooseOptimalSize(Android.Util.Size[] choices, int textureViewWidth,
int textureViewHeight, int maxWidth, int maxHeight, Android.Util.Size aspectRatio)
{
// Collect the supported resolutions that are at least as big as the preview Surface
var bigEnough = new List<Android.Util.Size>();
// Collect the supported resolutions that are smaller than the preview Surface
var notBigEnough = new List<Android.Util.Size>();
        float w = aspectRatio.Width;
        float h = aspectRatio.Height;
        float hw = h / w;

        // for (var i = 0; i < choices.Length; i++)
        foreach (var size in choices)
        {

            Android.Util.Size option = size;
            if ((option.Width <= maxWidth) && (option.Height <= maxHeight) &&
                    option.Height == option.Width * hw)

            {
                if (option.Width >= textureViewWidth &&
                    option.Height >= textureViewHeight)
                {
                    bigEnough.Add(option);
                }
                else
                {
                    notBigEnough.Add(option);
                }
            }
        }

        var sizeLinq = choices.Where(q => (q.Height * q.Width) <= (maxHeight * maxWidth)).OrderByDescending(element => element.Width * element.Height).FirstOrDefault();
        // Pick the smallest of those big enough. If there is no one big enough, pick the
        // largest of those not big enough.
        if (bigEnough.Count > 0)
        {
            return (Android.Util.Size)Collections.Min(bigEnough, new CompareSizesByArea());
        }
        //else if (sizeLinq != null)
        //{
        //    return sizeLinq;
        //}
        else if (notBigEnough.Count > 0)
        {
            return (Android.Util.Size)Collections.Max(notBigEnough, new CompareSizesByArea());
        }
        else
        {

            Log.Error(TAG, "Couldn't find any suitable preview size");
            return sizeLinq;
            //return choices.Where(q=>(q.Height * q.Width) <= (maxHeight* maxWidth)).OrderByDescending(element => element.Width * element.Height).First();
            // return choices[0];
        }
     }`

Basically the error is in the "else", the maximum resolution is returned if the appropriate one is not found. " return choices[0];"
else 			{ 				LogError("Couldn't find any suitable preview size"); 				return choices[0]; 			}

Basically the error is in the "else", the maximum resolution is returned if the appropriate one is not found. " return choices[0];"
else 			{ 				LogError("Couldn't find any suitable preview size"); 				return choices[0]; 			}

@jdarjona Thanks. Will test this tomorrow and prepare a PR, if everything is working as expected. Need to read the Camera2 API documentation first, to make a clear implementation.

@jdarjona Thanks. Will test this tomorrow and prepare a PR, if everything is working as expected. Need to read the Camera2 API documentation first, to make a clear implementation.

Thanks for the teamwork here folks! Appreciate it! :) Let me know how it goes and if you need any help from us.

Thanks for the teamwork here folks! Appreciate it! :) Let me know how it goes and if you need any help from us.


Allow net and IPC namespaces to be shared when userns=on

Now that the namespace sharing code via runc is vendored with the
containerd changes, we can disable the restrictions on container to
container net and IPC namespace sharing when the daemon has user
namespaces enabled.
Docker-DCO-1.1-Signed-off-by: Phil Estes<EMAIL_ADDRESS>(github: estesp)

LGTM

LGTM. Windows errors are unrelated, this only changes linux platform code.


Add clients library

Resolves #5.
Creates npm module bls-wallet-clients. More details in the added README.md.

Agreed @jacque006 , I thought I had a ticket for it, will create one now.


Changed "make:adminlte" to "adminlte:install" in README

can not merged, master branch is not for laravel 6, so the adminlte:install command comes with laravel 6 and is available on branch laravel6-adminlte2.

Ok, sorry. I had some problems because I was installing this package on a Laravel 6 installation, but after I found out in issues #355 that the command "make:adminlte" now is "adminlte:install".
I think that you have to write it in Readme

The old command is removed in the readme in named branch.


copy the workflow, but cant save the new workflow in Hue 4.2-cd6.0

when i copy a workflow from existing workflow, but i can not save the new workflow that i copy?
any one has the solution????

I also have this problem, can we solve it?


Powergate FAQs

Powergate FAQs gathered by some days of doing support in #powergate-users.
I'm not completely sure if using code quotes in ## sections is going to be rendered nicely.
Maybe there is a better-known strategy?
Anything extra apart from editing mkdocs for including this new file?

@andrew , thanks for the review... I wrote this thing too fast.


Ipad considerations

These are changes recommended by Microsoft PMs. Updates, retitles, and moves the iPad article to a better ToC location.

Docs Build status updates of commit 2fc2d02:
:warning: Validation status: warnings

File
Status
Preview URL
Details

docs/develop/develop-office-add-ins-for-the-ipad.md
:warning:Warning
View
Details

docs/toc.yml
:white_check_mark:Succeeded
View

docs/develop/develop-office-add-ins-for-the-ipad.md

Line 43, Column 431: [Warning-file-not-found] Invalid file link: '../testing/sideload-an-office-add-in-on-ipad-and-mac'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 17ec487:
:clock10: Pending: waiting for processors (5 builds ahead of you)
:warning: Docs Build is busy, currently there are 5 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit 17ec487:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/develop/develop-office-add-ins-for-the-ipad.md
:white_check_mark:Succeeded
View

docs/toc.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Set API_KEY from props?

I'm only getting API_KEY via props, is there a way to pass that to GoogleMapLoader?

Did you try this :
const API_KEY = ...
googleMapsLoader(YourComponent, {
  libraries: ["places", "geometry"],
  key: API_KEY,
})

Yeah, but I mean the only place I have access to API_KEY is in props, like this.props.apiKey or whatever. Is there any way I can pass it into googleMapsLoader from those?

I understand now. I don't know the markup to do want you want but maybe there is a way.
Nevermind, I plan to release a new version of this plugin using renderProps and not an HOC anymore. It should be ok for you after that

@xuopled Thank you! That sounds awesome

Check out the v4.0.0 I juste release !
Le 24 oct. 2017 20:36, "Max Malm"<EMAIL_ADDRESS>a écrit :

@xuopled https://github.com/xuopled Thank you! That sounds awesome
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/xuopled/react-google-places-suggest/issues/14#issuecomment-339089328,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACjxpOMlUqqGuVg7CX3KFsk8n4P00_whks5svi5GgaJpZM4QEFBd
.

@benjick  Check out the v4.0.0 I juste release !


[CodeCompletion] Update member completion to handle ambiguous and invalid base expressions

This hooks up member completion to the new typeCheckForCodeCompletion API to generate completions from all solutions the constraint solver produces – including ones requiring fixes – rather than relying on a single solution being applied to the AST (if any). This lets us still produce member completion results when the base expression is ambiguous or invalid.
Whenever typeCheckExpression is called on an expression containing a code completion expression and a CompletionCallback has been set, each solution formed is passed to the callback so the type and decl of the base expression can be extracted along with any other info needed to generate member completions.

@swift-ci please test

@swift-ci Please Build Toolchain macOS Platform

/cc @hborla @DougGregor

macOS Toolchain
Download Toolchain
Git Sha - 491b691dbce23fe0896e835c4a36202b4bcf8935
Install command
tar -zxf  swift-PR-33749-669-osx.tar.gz --directory ~/

Build failed
Swift Test OS X Platform
Git Sha - 491b691dbce23fe0896e835c4a36202b4bcf8935

@swift-ci please test macOS platform

Toolchain https://ci.swift.org/job/swift-PR-toolchain-osx/677/artifact/branch-master/swift-PR-33749-677-osx.tar.gz

@swift-ci clean test

@swift-ci please test

Build failed
Swift Test Linux Platform
Git Sha - d60116d11a7049a051b350b98057f05ebdda1727

Build failed
Swift Test OS X Platform
Git Sha - d60116d11a7049a051b350b98057f05ebdda1727

@swift-ci please test

Build failed
Swift Test OS X Platform
Git Sha - 7a06792e5df8705f1a2005f0c0a04069ebb1c1ed

Build failed
Swift Test Linux Platform
Git Sha - 7a06792e5df8705f1a2005f0c0a04069ebb1c1ed

@swift-ci please test Linux


Fix query.go assignment mismatch

Fix for https://github.com/chromedp/chromedp/issues/1031

Addressed by https://github.com/chromedp/chromedp/commit/b88710e33da89f65c9ed750381125aea3922254c


Intermediate pull request before merging into main branch

The youwuyou/type-interoperability-awaiting-jll at current stage will not pass the CI as the ginkgo_jll.jl package hosted under https://github.com/youwuyou/ginkgo_jll.jl is not up-to-date yet. Once we implemented more functionalities we will merge this branch into the  youwuyou/type-interoperability branch to see if CI passes, and then merge into main and switch to use the ginkgo_jll under JuliaBinaryWrappers.

Close pull request as we would change to merge from develop branch instead


VS Code does not understand ANSI escape sequences

VSCode Version: 1.50.1
OS Version: Windows 10 Professional (64 Bit), version 2004

Steps to Reproduce:

run an application that output ANSI char in the terminal. in my case C++, with a fprintf such as fprintf(outputFile, "\x1B[%dm", levelColors[level]);

When I watch the terminal, I can't see the color as they should be, but lots of char messes:

What shell are you using and do you have terminal.integrated.windowsEnableConpty set?

@Tyriar here's my settings:
{
  "workbench.sideBar.location": "right",
  "terminal.integrated.shell.windows": "C:/msys64/usr/bin/bash.exe",
  "terminal.integrated.shellArgs.windows": [
    "-i"
  ],
  "terminal.integrated.env.windows": {
    "MSYSTEM": "MINGW64",
    "PATH": "/mingw64/bin:/usr/local/bin:/usr/bin:/bin:${env:windir}/System32:${env:windir}:${env:PATH}"
  },
  "terminal.integrated.cwd": "c:\\repos\\",
  "extensions.ignoreRecommendations": false,
  "files.autoSave": "off",
  "diffEditor.ignoreTrimWhitespace": false
}

This is related to the fact that you're using msys64/mintty which I don't think has great support for conpty, the relatively new component from the Windows terminal team which does support these sequences. Nothing we can do on our side here.

@Tyriar till build 2004 on windows, I was able to do this placing  -mconsole on build and changing buffer using std::setvbuf(outputFile, nullptr, _IOFBF, BUFSIZ);.
Why now this is not possible anymore? Can you explain me?

@Nowhk I'm not sure what that means? This issue's about ansi support breaking in mintty?

@Tyriar @Nowhk
Support for ANSI it's n̲o̲t̲ e̲n̲a̲b̲l̲e̲d̲ by default on Windows 10 console host,
unless the specific software you're using enables ANSI processing by calling the SetConsoleMode API with the ENABLE_VIRTUAL_TERMINAL_PROCESSING (0x0400) flag, you won't see colors or get ANSI processing for that application.
Or you can enable it globally with the regkey HKEY_CURRENT_USER\Console\VirtualTerminalLevel  with value key "VirtualTerminalLevel"=dword:00000001.
https://docs.microsoft.com/en-us/windows/console/console-virtual-terminal-sequences#example


bad_alloc even with swap being available

Hi Team!
Im getting bad_alloc during xgboost train test iterations in cross validation
I have very specific cross validation in Python, thus we iterate over chunks of numpy array for train and test
Some of the train array sizes only fits in memory using the swap on linux (say additional 30-50 GB of swap memory).
It seems that right after some swap memory is used xgboost crashes
is it expected result?

Version is 0.81 from here https://s3-us-west-2.amazonaws.com/xgboost-wheels/list.html?prefix=
Just ran some experiments. The code crashed even at 50% of RAM being used
stack trace:
terminate called after throwing an instance of 'thrust::system::detail::bad_alloc'
what():  std::bad_alloc: out of memory

Current dataset 2_000_000 rows x 1500 features
on 0.72
When dataset was around 2 mio x 1000, it never crashed, even though RAM consumptions went up to 90%

Just tried with old 0.72 multigpu version, same code, same dataset
File "/home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/training.py", line 204, in train
xgb_model=xgb_model, callbacks=callbacks)
File "/home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/training.py", line 74, in _train_internal
bst.update(dtrain, i, obj)
File "/home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/core.py", line 894, in update
dtrain.handle))
File "/home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/core.py", line 130, in _check_call
raise XGBoostError(_LIB.XGBGetLastError())
xgboost.core.XGBoostError: b'[08:55:41] /workspace/src/tree/updater_gpu_hist.cu:572: GPU plugin exception: /workspace/src/tree/../common/device_helpers.cuh(560): unspecified launch failure\n\n\nStack trace returned 10 entries:\n[bt] (0) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(dmlc::StackTrace()+0x47) [0x7f9aa8ac82f7]\n[bt] (1) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x18) [0x7f9aa8ac89a8]\n[bt] (2) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(xgboost::tree::GPUHistMaker::Update(xgboost::HostDeviceVector<xgboost::detail::GradientPairInternal >, xgboost::DMatrix, std::vector<xgboost::RegTree*, std::allocatorxgboost::RegTree* > const&)+0x2b6) [0x7f9aa8cf86f6]\n[bt] (3) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(xgboost::gbm::GBTree::BoostNewTrees(xgboost::HostDeviceVector<xgboost::detail::GradientPairInternal >, xgboost::DMatrix, int, std::vector<std::unique_ptr<xgboost::RegTree, std::default_deletexgboost::RegTree >, std::allocator<std::unique_ptr<xgboost::RegTree, std::default_deletexgboost::RegTree > > >)+0x5a8) [0x7f9aa8b43ab8]\n[bt] (4) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(xgboost::gbm::GBTree::DoBoost(xgboost::DMatrix, xgboost::HostDeviceVector<xgboost::detail::GradientPairInternal >, xgboost::ObjFunction)+0x8c6) [0x7f9aa8b44836]\n[bt] (5) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(xgboost::LearnerImpl::UpdateOneIter(int, xgboost::DMatrix*)+0x3b8) [0x7f9aa8b73838]\n[bt] (6) /home/yhgtemp/anaconda3/lib/python3.6/site-packages/xgboost/./lib/libxgboost.so(XGBoosterUpdateOneIter+0x2b) [0x7f9aa8b0789b]\n[bt] (7) /home/yhgtemp/anaconda3/lib/python3.6/lib-dynload/../../libffi.so.6(ffi_call_unix64+0x4c) [0x7f9ac6e81ec0]\n[bt] (8) /home/yhgtemp/anaconda3/lib/python3.6/lib-dynload/../../libffi.so.6(ffi_call+0x22d) [0x7f9ac6e8187d]\n[bt] (9) /home/yhgtemp/anaconda3/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(_ctypes_callproc+0x2ce) [0x7f9ac7096e2e]\n\n'
terminate called after throwing an instance of 'thrust::system::system_error'
what():  parallel_for failed: unspecified launch failure

Seems like this issue https://github.com/dmlc/xgboost/issues/2874
Code crashes on predict part, on 7-8 iterations through cv folds

@hlbkin Maybe you can try external_memory on CPU after #4193 being merged.  Other than that, there's not much we can do about bad_alloc.  We can try optimizing memory usage as we go, but that won't happen over night.

@trivialfis is that GPU failing because of temporary memory burst?

@hlbkin Possibly.  But I think you can use tools like nvidia-smi to monitor the status of GPU.  And please use latest version,  I have been fixing various bugs for XGBoost, it not gonna be bug free but still I believe the latest commit is much more robust 0.7x.

Yes, using 0.81 is much better, generally do not have this kind of behaviour, and does not crash with same dataset
nvidia-smi does not really show memory bursts - i.e. generally GPU is using less then 50% of memory and then suddenly crashes (with 0.72).
I will run some tests with bigger (but similar) dataset and report

@hlbkin Are things looking better now?

Yes, everything is fine for now. But what I did also was moving numpy dataset to float32 manually (which is natural for xgboost as I understood)


Report and compare benchmark runs against two branches

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
When we make PRs like @jaylmiller 's https://github.com/apache/arrow-datafusion/pull/5292 or #3463  we often want to know "does this make existing benchmarks faster / slower". To answer this question we would like to:

Run benchmarks on main
Run benchmarks on the PR
Compare the results

This workflow is supported well for the criterion based microbenchmarks in https://github.com/apache/arrow-datafusion/tree/main/datafusion/core/benches (by using criterion directly or using the https://github.com/BurntSushi/critcmp)
However, for the "end to end" benchmarks in https://github.com/apache/arrow-datafusion/tree/main/benchmarks there is no easy way I know of to do two runs and compare results.
Describe the solution you'd like
There is a "machine readable" output format generated with the -o parameter (as shown below)

I would like a script that that compares the output of two  benchmark runs. Ideally written either in bash or python.
Instructions on how to run the script added to https://github.com/apache/arrow-datafusion/tree/main/benchmarks

So the workflow would be
Step 1: to create two or more output files using -o:
alamb@aal-dev:~/arrow-datafusion2/benchmarks$ cargo run --release --bin tpch -- benchmark datafusion --iterations 5 --path ~/tpch_data/parquet_data_SF1 --format parquet -o main

This produces files like in benchmarks.zip. Here is an example
{
  "context": {
    "benchmark_version": "19.0.0",
    "datafusion_version": "19.0.0",
    "num_cpus": 8,
    "start_time":<PHONE_NUMBER>,
    "arguments": [
      "benchmark",
      "datafusion",
      "--iterations",
      "5",
      "--path",
      "/home/alamb/tpch_data/parquet_data_SF1",
      "--format",
      "parquet",
      "-o",
      "main"
    ]
  },
  "queries": [
    {
      "query": 1,
      "iterations": [
        {
          "elapsed": 1555.030709,
          "row_count": 4
        },
        {
          "elapsed": 1533.61753,
          "row_count": 4
        },
        {
          "elapsed": 1551.0951309999998,
          "row_count": 4
        },
        {
          "elapsed": 1539.953467,
          "row_count": 4
        },
        {
          "elapsed": 1541.992357,
          "row_count": 4
        }
      ],
      "start_time":<PHONE_NUMBER>
    },
    ...

Step 2: Compare the two files and prepare a report
benchmarks/compare_results branch.json main.json

Which would produce an output report of some type. Here is an example  of an output output (from @korowa on https://github.com/apache/arrow-datafusion/pull/5490#issuecomment-1459826565). Maybe they have a script they could share
Query               branch         main
----------------------------------------------
Query 1 avg time:   1047.93 ms     1135.36 ms
Query 2 avg time:   280.91 ms      286.69 ms
Query 3 avg time:   323.87 ms      351.31 ms
Query 4 avg time:   146.87 ms      146.58 ms
Query 5 avg time:   482.85 ms      463.07 ms
Query 6 avg time:   274.73 ms      342.29 ms
Query 7 avg time:   750.73 ms      762.43 ms
Query 8 avg time:   443.34 ms      426.89 ms
Query 9 avg time:   821.48 ms      775.03 ms
Query 10 avg time:  585.21 ms      584.16 ms
Query 11 avg time:  247.56 ms      232.90 ms
Query 12 avg time:  258.51 ms      231.19 ms
Query 13 avg time:  899.16 ms      885.56 ms
Query 14 avg time:  300.63 ms      282.56 ms
Query 15 avg time:  346.36 ms      318.97 ms
Query 16 avg time:  198.33 ms      184.26 ms
Query 17 avg time:  4197.54 ms     4101.92 ms
Query 18 avg time:  2726.41 ms     2548.96 ms
Query 19 avg time:  566.67 ms      535.74 ms
Query 20 avg time:  1193.82 ms     1319.49 ms
Query 21 avg time:  1027.00 ms     1050.08 ms
Query 22 avg time:  120.03 ms      111.32 ms

Describe alternatives you've considered
Another possibility might be to move the specialized benchmark binaries into criterion (so they look like "microbench"es but I think this is non ideal because of the number of parameters supported by the benchmarks
Additional context

I could take this one up in the next few days if a new contributor does not end up picking this up as their first issue.

Here is an example of an output output (from @korowa on https://github.com/apache/arrow-datafusion/pull/5490#issuecomment-1459826565). Maybe they have a script they could share

Unfortunately it was just
cargo run --release --bin tpch -- benchmark datafusion --iterations 5 --path ./parquet --format parquet | grep "avg time"

and "multiline cursor" feature of IDE 🥲

Hi, I would like to take a crack at it. I will try to do it in python.

Thanks!

That would be great @Taza53  -- thank you.
I spent some time gathering data (into  benchmarks.zip ) so hopefully you don't have to actually make the datasets or run the benchmarks to make this script.

BTW the first thing I hope/plan to do with this script is gather enough data to do https://github.com/apache/arrow-datafusion/issues/4085

@isidentical  had a script they shared here: https://gist.github.com/isidentical/4e3fff1350e9d49672e15d54d9e8299f

I spent some time gathering data (into benchmarks.zip ) so hopefully you don't have to actually make the datasets or run the benchmarks to make this script.

Thank you for gathering data, it's very helpful.

@isidentical had a script they shared here: https://gist.github.com/isidentical/4e3fff1350e9d49672e15d54d9e8299f

I will take a look at it

BTW the first thing I hope/plan to do with this script is gather enough data to do #4085

I am a bit unsure, can you elaborate on this.

BTW the first thing I hope/plan to do with this script is gather enough data to do https://github.com/apache/arrow-datafusion/issues/4085

I am a bit unsure, can you elaborate on this.

Yes -- sorry -- all I was trying to say is that I am excited to use the script and will try it likely as soon as you have it available for a "real" usecase (basically to test https://github.com/apache/arrow-datafusion/issues/4085)

I think this should support multiple benches: right now just tpch has the -o opt.
This means the other benches would be modified to have the -o option and made so that they output json in the same structure as tpch (so the same script that @Taza53 is working on can be used) . I can work on a PR for this if you think that would make sense @alamb ?

This means the other benches would be modified to have the -o option and made so that they output json in the same structure as tpch (so the same script that @Taza53 is working on can be used) . I can work on a PR for this if you think that would make sense @alamb ?

I think that sounds like a great idea -- thank you

python compare.py path1 path2

https://gist.github.com/Taza53/beb42c5918d352f9b760befaa87baef9
I have made some changes to the original. Any recommendations that I can do.

I tried it out and it worked great (see https://github.com/apache/arrow-datafusion/pull/5099#issuecomment-1476741489). I will prepare a PR with the script and some instructions.

Created https://github.com/apache/arrow-datafusion/pull/5655 -- thanks @Taza53  ❤

I've added -o functionality to all the e2e benches in #5658 so this new script should be usable with every bench.