azure-core testcase hang issue

i've seen this many times
Updating test list for fixtures
Added 0 tests to meet fixture requirements
Checking test dependency graph...
Checking test dependency graph end
test 1
    Start 1: azure-core-test

1: Test command: D:\a\1\s\build\sdk\core\azure-core\test\ut\Debug\azure-core-test.exe
1: Test timeout computed to be: 10000000
1: [==========] Running 39 tests from 7 test suites.
1: [----------] Global test environment set-up.
1: [----------] 21 tests from TransportAdapter
1: [ RUN      ] TransportAdapter.customSizePutFromFile
1: [       OK ] TransportAdapter.customSizePutFromFile (56 ms)
1: [ RUN      ] TransportAdapter.customSizePutFromFileDefault
1: [       OK ] TransportAdapter.customSizePutFromFileDefault (46 ms)
1: [ RUN      ] TransportAdapter.customSizePutFromFileBiggerPage
1: [       OK ] TransportAdapter.customSizePutFromFileBiggerPage (35 ms)
1: [ RUN      ] TransportAdapter.get
1: [       OK ] TransportAdapter.get (35 ms)
1: [ RUN      ] TransportAdapter.get204
1: [       OK ] TransportAdapter.get204 (23 ms)
1: [ RUN      ] TransportAdapter.getLoop
1: [       OK ] TransportAdapter.getLoop (415 ms)
1: [ RUN      ] TransportAdapter.head
1: [       OK ] TransportAdapter.head (32 ms)
1: [ RUN      ] TransportAdapter.put
1: [       OK ] TransportAdapter.put (23 ms)
1: [ RUN      ] TransportAdapter.deleteRequest
1: [       OK ] TransportAdapter.deleteRequest (10 ms)
1: [ RUN      ] TransportAdapter.patch
1: [       OK ] TransportAdapter.patch (19 ms)
1: [ RUN      ] TransportAdapter.getChunk
1: [       OK ] TransportAdapter.getChunk (1302 ms)
1: [ RUN      ] TransportAdapter.getWithStream
1: [       OK ] TransportAdapter.getWithStream (46 ms)
1: [ RUN      ] TransportAdapter.getLoopWithStream
1: [       OK ] TransportAdapter.getLoopWithStream (430 ms)
1: [ RUN      ] TransportAdapter.headWithStream
1: [       OK ] TransportAdapter.headWithStream (20 ms)
1: [ RUN      ] TransportAdapter.putWithStream
1: [       OK ] TransportAdapter.putWithStream (25 ms)
1: [ RUN      ] TransportAdapter.deleteRequestWithStream
1: [       OK ] TransportAdapter.deleteRequestWithStream (27 ms)
1: [ RUN      ] TransportAdapter.patchWithStream
1: [       OK ] TransportAdapter.patchWithStream (23 ms)
1: [ RUN      ] TransportAdapter.getChunkWithStream
1: [       OK ] TransportAdapter.getChunkWithStream (1296 ms)
1: [ RUN      ] TransportAdapter.createResponseT
1: [       OK ] TransportAdapter.createResponseT (27 ms)
1: [ RUN      ] TransportAdapter.customSizePut
1: [       OK ] TransportAdapter.customSizePut (170 ms)
1: [ RUN      ] TransportAdapter.putWithStreamOnFail

unittest hangs at TransportAdapter.putWithStreamOnFail

@JinmingHu-MSFT Can you attach the test output and callstack.

i'll reopen this next time I encounter it.

Pipelines Result
Raw log
2020-08-16T02:27:05.4716433Z ##[section]Starting: ctest
2020-08-16T02:27:05.5051052Z ==============================================================================
2020-08-16T02:27:05.5052420Z Task         : Command line
2020-08-16T02:27:05.5053043Z Description  : Run a command line script using Bash on Linux and macOS and cmd.exe on Windows
2020-08-16T02:27:05.5053754Z Version      : 2.164.2
2020-08-16T02:27:05.5054051Z Author       : Microsoft Corporation
2020-08-16T02:27:05.5054476Z Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/command-line
2020-08-16T02:27:05.5055055Z ==============================================================================
2020-08-16T02:27:06.8945378Z Generating script.
2020-08-16T02:27:06.9231648Z Script contents:
2020-08-16T02:27:06.9350298Z ctest -V --tests-regex azure-core
2020-08-16T02:27:06.9808851Z ========================== Starting Command Output ===========================
2020-08-16T02:27:07.0344630Z ##[command]"C:\windows\system32\cmd.exe" /D /E:ON /V:OFF /S /C "CALL "D:\a\_temp\001e5e17-5d4e-4116-9bd7-4ffafa4f2935.cmd""
2020-08-16T02:27:07.8958117Z UpdateCTestConfiguration  from :D:/a/1/s/build/DartConfiguration.tcl
2020-08-16T02:27:08.0277532Z UpdateCTestConfiguration  from :D:/a/1/s/build/DartConfiguration.tcl
2020-08-16T02:27:08.0330119Z Test project D:/a/1/s/build
2020-08-16T02:27:08.0342550Z Constructing a list of tests
2020-08-16T02:27:08.0516536Z Done constructing a list of tests
2020-08-16T02:27:08.0517513Z Updating test list for fixtures
2020-08-16T02:27:08.0518365Z Added 0 tests to meet fixture requirements
2020-08-16T02:27:08.0723978Z Checking test dependency graph...
2020-08-16T02:27:08.0726098Z Checking test dependency graph end
2020-08-16T02:27:08.0727617Z test 1
2020-08-16T02:27:08.0733345Z     Start 1: azure-core-test
2020-08-16T02:27:08.0739703Z
2020-08-16T02:27:08.0740782Z 1: Test command: D:\a\1\s\build\sdk\core\azure-core\test\ut\Debug\azure-core-test.exe
2020-08-16T02:27:08.0741788Z 1: Test timeout computed to be: 10000000
2020-08-16T02:27:08.3773759Z 1: [==========] Running 47 tests from 8 test suites.
2020-08-16T02:27:08.3775215Z 1: [----------] Global test environment set-up.
2020-08-16T02:27:08.3775943Z 1: [----------] 21 tests from TransportAdapter
2020-08-16T02:27:08.3776747Z 1: [ RUN      ] TransportAdapter.customSizePutFromFile
2020-08-16T02:27:09.0413426Z 1: [       OK ] TransportAdapter.customSizePutFromFile (667 ms)
2020-08-16T02:27:09.0414805Z 1: [ RUN      ] TransportAdapter.customSizePutFromFileDefault
2020-08-16T02:27:09.6594393Z 1: [       OK ] TransportAdapter.customSizePutFromFileDefault (619 ms)
2020-08-16T02:27:09.6595857Z 1: [ RUN      ] TransportAdapter.customSizePutFromFileBiggerPage
2020-08-16T02:27:10.2856005Z 1: [       OK ] TransportAdapter.customSizePutFromFileBiggerPage (625 ms)
2020-08-16T02:27:10.2857273Z 1: [ RUN      ] TransportAdapter.get
2020-08-16T02:27:10.5727530Z 1: [       OK ] TransportAdapter.get (287 ms)
2020-08-16T02:27:10.5729450Z 1: [ RUN      ] TransportAdapter.get204
2020-08-16T02:27:10.6176882Z 1: [       OK ] TransportAdapter.get204 (45 ms)
2020-08-16T02:27:10.6178140Z 1: [ RUN      ] TransportAdapter.getLoop
2020-08-16T02:27:13.5755485Z 1: [       OK ] TransportAdapter.getLoop (2957 ms)
2020-08-16T02:27:13.5756675Z 1: [ RUN      ] TransportAdapter.head
2020-08-16T02:27:13.7131755Z 1: [       OK ] TransportAdapter.head (137 ms)
2020-08-16T02:27:13.7133600Z 1: [ RUN      ] TransportAdapter.put
2020-08-16T02:27:13.9181447Z 1: [       OK ] TransportAdapter.put (205 ms)
2020-08-16T02:27:13.9182556Z 1: [ RUN      ] TransportAdapter.deleteRequest
2020-08-16T02:27:14.0610364Z 1: [       OK ] TransportAdapter.deleteRequest (143 ms)
2020-08-16T02:27:14.0611428Z 1: [ RUN      ] TransportAdapter.patch
2020-08-16T02:27:14.2092808Z 1: [       OK ] TransportAdapter.patch (148 ms)
2020-08-16T02:27:14.2094004Z 1: [ RUN      ] TransportAdapter.getChunk
2020-08-16T02:27:15.6607148Z 1: [       OK ] TransportAdapter.getChunk (1452 ms)
2020-08-16T02:27:15.6609154Z 1: [ RUN      ] TransportAdapter.getWithStream
2020-08-16T02:27:15.9629359Z 1: [       OK ] TransportAdapter.getWithStream (302 ms)
2020-08-16T02:27:15.9631619Z 1: [ RUN      ] TransportAdapter.getLoopWithStream
2020-08-16T02:27:18.8472659Z 1: [       OK ] TransportAdapter.getLoopWithStream (2884 ms)
2020-08-16T02:27:18.9897127Z 1: [ RUN      ] TransportAdapter.headWithStream
2020-08-16T02:27:18.9899135Z 1: [       OK ] TransportAdapter.headWithStream (143 ms)
2020-08-16T02:27:18.9899976Z 1: [ RUN      ] TransportAdapter.putWithStream
2020-08-16T02:27:19.1984603Z 1: [       OK ] TransportAdapter.putWithStream (209 ms)
2020-08-16T02:27:19.1986285Z 1: [ RUN      ] TransportAdapter.deleteRequestWithStream
2020-08-16T02:27:19.3488722Z 1: [       OK ] TransportAdapter.deleteRequestWithStream (150 ms)
2020-08-16T02:27:19.3490689Z 1: [ RUN      ] TransportAdapter.patchWithStream
2020-08-16T02:27:19.4948735Z 1: [       OK ] TransportAdapter.patchWithStream (146 ms)
2020-08-16T02:27:19.4960305Z 1: [ RUN      ] TransportAdapter.getChunkWithStream
2020-08-16T02:27:20.8926843Z 1: [       OK ] TransportAdapter.getChunkWithStream (1398 ms)
2020-08-16T02:27:20.8928371Z 1: [ RUN      ] TransportAdapter.createResponseT
2020-08-16T02:27:21.0392738Z 1: [       OK ] TransportAdapter.createResponseT (146 ms)
2020-08-16T02:27:21.0395836Z 1: [ RUN      ] TransportAdapter.customSizePut
2020-08-16T02:27:22.1509944Z 1: [       OK ] TransportAdapter.customSizePut (1112 ms)
2020-08-16T02:27:22.1511097Z 1: [ RUN      ] TransportAdapter.putWithStreamOnFail
2020-08-16T03:07:02.3836133Z Terminate batch job (Y/N)?
2020-08-16T03:07:02.5973523Z ^C
2020-08-16T03:07:02.8611456Z ##[error]The operation was canceled.
2020-08-16T03:07:02.8641006Z ##[section]Finishing: ctest

This is not a crash issue, so there's no callstack. it's a hang issue.

here's another one https://dev.azure.com/azure-sdk/internal/_build/results?buildId=499192&view=logs&jobId=becb4c78-6d46-5b40-696d-491037a3748a&j=becb4c78-6d46-5b40-696d-491037a3748a&t=7da4ec77-80ef-5cae-b212-17e17d7c0a17

this is a potential bug in Core HTTP Client. I can reproduce this issue on both Linux and Windows. Run azure-core-test with --gtest_filter=TransportAdapter.putWithStreamOnFail --gtest_repeat=3. It always hangs at the second time.

The server closes the connection after the first request. There must be something wrong with connection reuse.
$ curl -X PUT "http://httpbin.org/get" --data-binary "@file" --next -X PUT "http://httpbin.org/get" --data-binary "@file" -v
*   Trying <IP_ADDRESS>...
* TCP_NODELAY set
* Connected to httpbin.org (<IP_ADDRESS>) port 80 (#0)
> PUT /get HTTP/1.1
> Host: httpbin.org
> User-Agent: curl/7.54.0
> Accept: */*
> Content-Length: 1024
> Content-Type: application/x-www-form-urlencoded
>
* upload completely sent off: 1024 out of 1024 bytes
< HTTP/1.1 405 METHOD NOT ALLOWED
< Date: Thu, 27 Aug 2020 06:11:32 GMT
< Content-Type: text/html
< Content-Length: 178
< Connection: keep-alive
< Server: gunicorn/19.9.0
< Allow: GET, OPTIONS, HEAD
< Access-Control-Allow-Origin: *
< Access-Control-Allow-Credentials: true
<
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<title>405 Method Not Allowed</title>

Method Not Allowed

The method is not allowed for the requested URL.

* Connection #0 to host httpbin.org left intact
* Found bundle for host httpbin.org: 0x7fd5c8e0cd00 [can pipeline]
* Connection 0 seems to be dead!
* Closing connection 0
* Hostname httpbin.org was found in DNS cache
*   Trying <IP_ADDRESS>...
* TCP_NODELAY set
* Connected to httpbin.org (<IP_ADDRESS>) port 80 (#1)
> PUT /get HTTP/1.1
> Host: httpbin.org
> User-Agent: curl/7.54.0
> Accept: */*
> Content-Length: 1024
> Content-Type: application/x-www-form-urlencoded
>
* upload completely sent off: 1024 out of 1024 bytes
< HTTP/1.1 405 METHOD NOT ALLOWED
< Date: Thu, 27 Aug 2020 06:11:33 GMT
< Content-Type: text/html
< Content-Length: 178
< Connection: keep-alive
< Server: gunicorn/19.9.0
< Allow: GET, OPTIONS, HEAD
< Access-Control-Allow-Origin: *
< Access-Control-Allow-Credentials: true
<
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<title>405 Method Not Allowed</title>

Method Not Allowed

The method is not allowed for the requested URL.

* Connection #1 to host httpbin.org left intact

the issue is gone, cannot reproduce anymore

A program that can reproduce this issue
#include <iostream>
#include <memory>
#include <vector>

#include "azure/core/http/curl/curl.hpp"
#include "azure/core/http/http.hpp"
#include "azure/core/http/pipeline.hpp"

int main() {
  using namespace Azure::Core;
  using namespace Azure::Core::Http;
  using namespace std;

  std::string host("http://httpbin.org/get");

  for (int i = 0; i < 10; ++i)
  {
    std::cout << "i == " << i << std::endl;
    // Create the Transport
    std::shared_ptr<HttpTransport> transport = std::make_unique<CurlTransport>();

    std::vector<std::unique_ptr<HttpPolicy>> policies;

    // Add the transport policy
    policies.push_back(std::make_unique<TransportPolicy>(std::move(transport)));

    auto httpPipeline = Http::HttpPipeline(policies);

    auto context = Azure::Core::GetApplicationContext();

    // PUT 1k
    auto requestBodyVector = std::vector<uint8_t>(1024, 'x');
    auto bodyRequest = Azure::Core::Http::MemoryBodyStream(requestBodyVector);
    auto request
        = Azure::Core::Http::Request(Azure::Core::Http::HttpMethod::Put, host, &bodyRequest, true);
    auto response = httpPipeline.Send(context, request);
    std::cout << "i == " << i << std::endl;
  }

}

@JinmingHu-MSFT , the issue in the provided test program is that the host url is http://httpbin.org/get
That url accepts GET.
Then you make a POST to that url.
I will take a look to see how we can protect the code from the hanging.

The issue is that Server closes the channel when the response is an Error.
Then next request was trying to re-use the same connection which was closed and it has hanging waiting for the socket to be writable.
Created PR to fix

There were 2 issue here.
One is fixed with the related PR.
For the other one I have created: https://github.com/Azure/azure-sdk-for-cpp/issues/550
It is a similar issue but requires more coding to be resolved.  I am disabling the test case that might be showing this issue.

Hi Victor, thanks for the fix, however, there is still some reoccurrence of the issue during our validation process and I will try to reproduce it with dummy PR and let you know about it.

https://github.com/Azure/azure-sdk-for-cpp/pull/556, please see the CI of this dummy PR, reproduces the issue.

Thank you @katmsft .  In this new case, it is a test issue.
I have a new PR with changes to the test: https://github.com/Azure/azure-sdk-for-cpp/issues/557
It might happen that in some cases, the time we were waiting for the cleaner to finish was not enough because it was already running from previous tests.
I moved this special test to be the first one so I don't need to increase the time too much.


FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory

I am on Mac OS X: Mojave 10.14
I am attempting to use typescript and Koa for a server but when trying to run the server, I got about a million lines of
2019-07-09 16:19 node[49110] (FSEvents.framework) process_dir_events: rename: watch_path() failed for '/dev/fd/1'

that continued for about 5 minutes and then got:
<--- Last few GCs --->

[49110:0x103cad000]   155881 ms: Mark-sweep 2008.5 (2050.8) -> 2008.4 (2051.8) MB, 2900.0 / 1.4 ms  (average mu = 0.187, current mu = 0.006) allocation failure scavenge might not succeed
[49110:0x103cad000]   158163 ms: Mark-sweep 2009.2 (2051.8) -> 2009.0 (2052.3) MB, 2274.7 / 1.3 ms  (average mu = 0.114, current mu = 0.003) allocation failure scavenge might not succeed

<--- JS stacktrace --->

==== JS stack trace =========================================

    0: ExitFrame [pc: 0x100a99f42]
Security context: 0x14d0ccc9a2f1 <JSObject>
    1: handler [0x14d0b46c06c1] [/Users/c.francia/Desktop/dicus/dicus/server/src/node_modules/fsevents/fsevents.js:~45] [pc=0x12e7cade7689](this=0x14d039604741 <JSGlobal Object>,0x14d0503bf9d1 <String[9]: /dev/fd/1>,32,0)
    2: InternalFrame [pc: 0x100a013fd]
    3: EntryFrame [pc: 0x100a01178]

==== Details ================================================

[0...

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory

Failed to open Node.js report file: report.20190709.161938.49110.0.001.json (errno: 24)
 1: 0x1000784a8 node::Abort() [/usr/local/bin/node]
 2: 0x100078b26 node::OnFatalError(char const*, char const*) [/usr/local/bin/node]
 3: 0x10016a275 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [/usr/local/bin/node]
 4: 0x10016a217 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [/usr/local/bin/node]
 5: 0x100430765 v8::internal::Heap::FatalProcessOutOfMemory(char const*) [/usr/local/bin/node]
 6: 0x1004315f6 v8::internal::Heap::HasLowYoungGenerationAllocationRate() [/usr/local/bin/node]
 7: 0x10042fa2d v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [/usr/local/bin/node]
 8: 0x10042e395 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/usr/local/bin/node]
 9: 0x1004353f8 v8::internal::Heap::AllocateRawWithLightRetry(int, v8::internal::AllocationType, v8::internal::AllocationAlignment) [/usr/local/bin/node]
10: 0x100435444 v8::internal::Heap::AllocateRawWithRetryOrFail(int, v8::internal::AllocationType, v8::internal::AllocationAlignment) [/usr/local/bin/node]
11: 0x100415968 v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationSpace) [/usr/local/bin/node]
12: 0x1005ffe7d v8::internal::Runtime_AllocateInNewSpace(int, unsigned long*, v8::internal::Isolate*) [/usr/local/bin/node]
13: 0x100a99f42 Builtins_CEntry_Return1_DontSaveFPRegs_ArgvOnStack_NoBuiltinExit [/usr/local/bin/node]

I also get this at the very beginning:
2019-07-09 17:15 node[64032] (FSEvents.framework) FSEventStreamStart: register_with_server: ERROR: f2d_register_rpc() => (null) (-21)
2019-07-09 17:15 node[64032] (FSEvents.framework) FSEventStreamStart: register_with_server: ERROR: f2d_register_rpc() => (null) (-21)2019-07-09 17:15 node[64032] (FSEvents.framework) FSEventStreamStart: register_with_server: ERROR: f2d_register_rpc() => (null) (-21)
2019-07-09 17:15 node[64032] (FSEvents.framework)
FSEventStreamStart: register_with_server: ERROR: f2d_register_rpc() => (null) (-21)
2019-07-09 17:15 node[64032] (FSEvents.framework) FSEventStreamStart: register_with_server: ERROR: f2d_register_rpc() => (null) (-21)

@ctfrancia can you share you code that uses FSEvents?

I am using nodemon and the error occurs whenever the the server crashes  and is waiting for an update to start again.  So maybe I should go there and post the issue since it might have to do with them?

In my case, fix this problem installing nodeJs Version 12.10.0

I was having this while using the node10-alpine docker image and my code would blow up upon receiving a very large array from MySQL.
Updated to node12-alpine and works very well now.

Yeah, just use the latest node and OS — this often fixed all kinds of issues.

Switched from v10 to v12, and still happens.

In my case, fix this problem installing nodeJs Version 12.10.0

Thanks for your suggestion. My problem also got resolved by updating the node version.

In my case, fix this problem installing nodeJs Version 12.10.0

Yes. Same for me on Xubuntu18.
These are the commands.
sudo su
#password
npm cache clean -f
npm install -g npm
npm install -g n
n latest
#n stable (alternative)

I am still having this issue very randomly on Heroku with Node v12.10.0

rm -rf node_modules package-lock.json yarn.lock && npm install
Upgrade your dependencies fsevents to latest version.
Upgrade your node.js to latest version.


Commit Order Calculator

Deletions need the reverse topological order to first remove thing that depend on others before removing the depended-upon data


Forward/rel/6.2.1

@ironman-machine check it

Hello @LaurenSpiegel
Starting end to end procedure using the following payload:
{"REPO_NAME": "S3", "SCALITY_S3_BRANCH": "forward/rel/6.2.1", "DEFAULT_BRANCH": "master"}
Please follow http://ci.ironmann.io/gh/scality/Integration/6491 for CI status.


Fix batch variable generation

Summary
Fixes https://github.com/Qiskit/qiskit-aqua/issues/1462
Copy of https://github.com/Qiskit/qiskit-aqua/pull/1507
This PR moves keys argument first to match with docplex interface. keys should be given explicitly because the methods are to generate multiple variables at once. keys=None does not make sense.
These methods are introduced only in master of Aqua and not yet included in the released version.
Details and comments

[X] Simplify the internal of variable generation.
[x] Cleanup of unit tests.
[x] Lint

Pull Request Test Coverage Report for Build 498278417

45 of 46 (97.83%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.009%) to 89.801%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

qiskit_optimization/problems/quadratic_program.py
45
46
97.83%

Totals

Change from base Build 497029568:
-0.009%

Covered Lines:
3152

Relevant Lines:
3510

💛  - Coveralls

Pull Request Test Coverage Report for Build 498278417

45 of 46 (97.83%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.009%) to 89.801%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

qiskit_optimization/problems/quadratic_program.py
45
46
97.83%

Totals

Change from base Build 497029568:
-0.009%

Covered Lines:
3152

Relevant Lines:
3510

💛  - Coveralls

@adekusar-drl I copied https://github.com/Qiskit/qiskit-aqua/pull/1507 and fixed a corner case that causes an infinite loop. Could you take a look at it?

@adekusar-drl I copied https://github.com/Qiskit/qiskit-aqua/pull/1507 and fixed a corner case that causes an infinite loop. Could you take a look at it?


Syntax highlighting for Swift code

This PR adds support for syntax highlighting for Swift code. There is a new parameter on Code.init() called language. This is an enum, which can currently be set to .swift and .none for no syntax highlighting.
This closes issue #8
I'm not 100% happy with the API, as the language parameter is currently at the end of the parameter list for Code.init(), which if you have a large string of code before that, it can be kind of "lost".
Additionally, I think there are two different functions with similar names: enableHighlight, which allows you to select single lines of code to go through and syntax highlighting, which is to make colorful code. This may be something that should be looked into.
I'm 100% open to suggestions to either of these two deficiencies (in my view). If no one else thinks they're problematic, I'm happy to go with the group on this one.
https://user-images.githubusercontent.com/8521453/189717086-c5c0d26d-b0b0-4a8f-aa65-14e5438d9373.mov

Love it! 💜

hmm, @yonomitt I swapped to your branch, but do not see any Syntax highlight?
      Code(.swift) {
        """
        print("hello")
        if 1 < 2 {
          exit(0)
        }

I think I added a code theme to the default .dark, but I didn't touch any of the other themes.
This definitely needs to be documented at some point 😀

@yonomitt 'CodeTheme' initializer is inaccessible due to 'internal' protection level 🙈

Just presented a talk using this branch and it went great! +1 to merge

@FullQueueDeveloper Did you really give a talk with DeckUI?! I would love to link to it from the README if you would like to share it in any form 😊😊😊😊😊😊😊

@yonomitt 'CodeTheme' initializer is inaccessible due to 'internal' protection level 🙈
Could you kindly add a public member-wise initializer?
 public init(font: SwiftUI.Font, plainTextColor: SwiftUI.Color, backgroundColor: SwiftUI.Color, tokenColors: [TokenType : SwiftUI.Color]) {
    self.font = font
    self.plainTextColor = plainTextColor
    self.backgroundColor = backgroundColor
    self.tokenColors = tokenColors
  }

Good point!  I would love to link to it from the README if you would like to share it in any form 😊😊😊😊😊😊😊

@joshdholtz yes I did! I'll ping you when the meetup organizers post the recording 😍 And I would be honored for a link in your README ✨

@FullQueueDeveloper Did you really give a talk with DeckUI?! I would love to link to it from the README if you would like to share it in any form 😊😊😊😊😊😊😊

Yes! The video is up! https://www.youtube.com/watch?v=SxozYjWMhgU
Also, I published my deck as well! https://github.com/FullQueueDeveloper/Deck-2022-09-13


Description isn't displayed in upload field admin UI Payload 3.0.0-beta.90

Link to reproduction
No response
Environment Info
@payloadcms/db-mongodb: 3.0.0-beta.90,
@payloadcms/next: 3.0.0-beta.90,
@payloadcms/richtext-lexical": 3.0.0-beta.90,
@payloadcms/storage-vercel-blob: 3.0.0-beta.90,
@payloadcms/ui: 3.0.0-beta.90,
lexical: 0.17.0,
next: 15.0.0-canary.130,
payload: 3.0.0-beta.90,
react: 19.0.0-beta-26f2496093-20240514,
react-dom: 19.0.0-beta-26f2496093-20240514,

Describe the Bug
I have this collection:
import { CollectionConfig } from "payload";

const Author: CollectionConfig = {
  slug: "authors",
  access: {},
  admin: {
    hideAPIURL: true,
  },
  fields: [
    {
      name: "image",
      label: "Author Image",
      type: "upload",
      relationTo: "profile-pictures",
      required: true,
      admin: {
        description:
          "This image will be used as the author image. Recommended size 176x176, optimized for web.",
      },
    },
    {
      name: "name",
      label: "Author Name",
      type: "text",
      required: true,
      admin: {
        description: "The name of the author",
      },
    },
  ],
};

export default Author;

The description for upload field does not appear in admin UI as it should similar to text field:

Reproduction Steps
As stated above
Adapters and Plugins
No response

This will be fixed in https://github.com/payloadcms/payload/pull/7978


Add option to set group for distcp-ng

@ibuenros can you review?

Addressed pr comments. @ibuenros take another look.

Just one comment, otherwise LGTM.


Release GIL before detecting faces

A small modification to release the GIL in the face_detector. Since the face_detector seemed to be single-threaded, I made this change.
I wrote some simple code to benchmark:
files = sys.argv[1:] * 16

def basic():
    detector = dlib.get_frontal_face_detector()
    for f in files:
        img = dlib.load_rgb_image(f)
        # The 1 in the second argument indicates that we should upsample the image
        # 1 time.  This will make everything bigger and allow us to detect more
        # faces.
        dets = detector(img, 1)

def threads(num_threads=8):
  file_chunks = np.array_split(np.asarray(files), num_threads)

  def work(files):
      detector = dlib.get_frontal_face_detector()

      for f in files:
          img = dlib.load_rgb_image(f)
          # The 1 in the second argument indicates that we should upsample the image
          # 1 time.  This will make everything bigger and allow us to detect more
          # faces.
          dets = detector(img, 1)

  threads = []
  for i in range(num_threads):
    threads.append(threading.Thread(target=work, args=(file_chunks[i],)))
    threads[-1].start()
  for thread in threads:
    thread.join()

import os; print(os.cpu_count())
num = 1
print("basic", timeit.timeit("basic()", number=num, globals=globals()))
print("threads", timeit.timeit("threads()", number=num, globals=globals()))

For the image which is processed 16 times by the face detector, I get the following results:
basic 19.069416782
threads 5.340275335000001

(Note that, different numbers of threads provide different amount of speedups, this is run with the code above).

Cool, that's a good idea :)
But is taking that py::array img and making a copy of it, which calls python functions.  So you can't unlock the gil there.  The gil needs to only be unlocked around code that is not calling into any python code.  So the unlock needs to be moved to be around only the actual detector execution.

Thank you for catching that!
Reading through the code, it seems the detector is passed a dlib::numpy_image which is a py::array_t and also a pyobject. I don't think any python functions are called on it, but I'm not a 100% sure - is it OK to just go ahead and scope the release to the detector call?

It's not clear to me either.  You need to refer to the pybind11 documentation to find out if it's ok to call that thing's methods when the GIL is not locked.  It wouldn't surprise me if it was making calls into the python runtime.  So you might have to make a temporary image (just some other struct that implements the image interface: http://dlib.net/dlib/image_processing/generic_image.h.html.  I.e. holds pointers to the image data and all that).  Then pass that struct instead since that struct would be clearly not calling python functions.

Er, what am I saying.  The image_view is itself a generic image.  So you can just call make_image_view to get an image that doesn't have any pybind11 stuff in it and then you just use that.

Thanks for your help. Changed per your suggestion.

Sweet, looks good.  Thanks for the PR :)


XRay works, but build fails with EOF error

Image marklambert/nextpvr-ccextractor
This image will eventually fail for other reasons because it uses .NET runtime, but this analysis failure should probably be looked at separately.
mark@Storage:~/docker-slim/dist_linux$ ./docker-slim build marklambert/nextpvr-ccextractor docker-slim[build]: info=http.probe message='using default probe' docker-slim[build]: state=started docker-slim[build]: info=params target=marklambert/nextpvr-ccextractor continue.mode=probe rt.as.user=true keep.perms=true docker-slim[build]: state=image.inspection.start docker-slim[build]: info=image id=sha256:9376732854714babe0f3efd7ec7f2f69c1e68a02315a700cbdb74b9fdfd43b0d size.bytes=594633103 size.human=595 MB docker-slim[build]: info=image.stack index=0 name='nextpvr/nextpvr_amd64:stable' id='sha256:567d433cd7009f51107d5fb1743bb54ee38e468be13e9a730c168a6461c72f75' docker-slim[build]: info=image.stack index=1 name='marklambert/nextpvr-ccextractor:latest' id='sha256:9376732854714babe0f3efd7ec7f2f69c1e68a02315a700cbdb74b9fdfd43b0d' docker-slim[build]: info=image.exposed_ports list='80,443' docker-slim[build]: state=image.inspection.done docker-slim[build]: state=container.inspection.start time="2020-04-05T09:05:50-06:00" level=error msg="dockerutil.BuildEmptyImage: dockerapi.BuildImage() error = unexpected EOF" time="2020-04-05T09:05:50-06:00" level=fatal msg="docker-slim: failure" error="unexpected EOF" stack="goroutine 1 [running]:\nruntime/debug.Stack(0x0, 0x0, 0x0)\n\truntime/debug/stack.go:24 +0x9d\ngithub.com/docker-slim/docker-slim/pkg/util/errutil.FailOn(0xb9ab20, 0xc000104060)\n\tgithub.com/docker-slim/docker-slim/pkg/util/errutil/errutil.go:14 +0x54\ngithub.com/docker-slim/docker-slim/internal/app/master/inspectors/container.(*Inspector).RunContainer(0xc0000f21e0, 0x4, 0xc000279f98)\n\tgithub.com/docker-slim/docker-slim/internal/app/master/inspectors/container/container_inspector.go:255 +0x339c\ngithub.com/docker-slim/docker-slim/internal/app/master/commands.OnBuild(0xc00007e050, 0x7ffdfc6b9d9e, 0x1f, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xaa2d01, ...)\n\tgithub.com/docker-slim/docker-slim/internal/app/master/commands/build.go:263 +0x1617\ngithub.com/docker-slim/docker-slim/internal/app/master.init.0.func10(0xc00007c160, 0x0, 0xc000302300)\n\tgithub.com/docker-slim/docker-slim/internal/app/master/cli.go:1655 +0x171a\ngithub.com/urfave/cli.HandleAction(0x9cd840, 0xad0bd8, 0xc00007c160, 0xc00007c160, 0x0)\n\tgithub.com/urfave/cli@v1.22.1/app.go:523 +0x11a\ngithub.com/urfave/cli.Command.Run(0xaa0a83, 0x5, 0x0, 0x0, 0xc00026ad40, 0x1, 0x1, 0xac41f6, 0x3e, 0x0, ...)\n\tgithub.com/urfave/cli@v1.22.1/command.go:174 +0x56e\ngithub.com/urfave/cli.(*App).Run(0xc000290000, 0xc00018c000, 0x3, 0x3, 0x0, 0x0)\n\tgithub.com/urfave/cli@v1.22.1/app.go:276 +0x7ae\ngithub.com/docker-slim/docker-slim/internal/app/master.runCli()\n\tgithub.com/docker-slim/docker-slim/internal/app/master/cli.go:2053 +0x55\ngithub.com/docker-slim/docker-slim/internal/app/master.Run()\n\tgithub.com/docker-slim/docker-slim/internal/app/master/app.go:6 +0x25\nmain.main()\n\tgithub.com/docker-slim/docker-slim/cmd/docker-slim/main.go:8 +0x20\n" version="linux|Transformer|1.29.0|afff2c9679a697ebfc933360267253a10325269d|2020-03-18_07:11:20PM"

Thanks for opening the issue @Ranbato ! This is a strange error... Building an empty image fails with the 'unexpected EOF' error... What version of Docker do you have? What linux distro/version are you using for the host? I'll try to repro the condition...
Speaking of the xray command... What kind of info were  you looking for? Is there's more you'd like to see?

I'm running Docker on my NAS so hopefully you can reproduce without the specific version of Linux.
Linux Storage 4.4.59+ #24922 SMP PREEMPT Mon Aug 19 12:13:37 CST 2019 x86_64 GNU/Linux synology_apollolake_918+
Docker version 18.09.8, build 2c0a67b
I wasn't looking for anything specific using xray, just trying to narrow down where the error was occurring.
If you can't reproduce from the above image, I can also attach the Dockerfile to see if that makes a difference.

@Ranbato thanks for the Docker version info! Yes, it'll be pretty helpful if you could share the Dockerfile

Here is the Dockerfile
Dockerfile.txt


Python3 retest

ran through most full featured sample and most simplest, both produced expected outputs

has been tested with python 3.6


Rhel support in dependency installer

semi support for RHEL 8 because

qt5 is broken on  rhel 8
there isn't a specific or-tools release for rhel 8

@vvbandeira
Still need to install:

[ ] OR-tools
[ ] QT5


bug: HTTPHandler doesn't respect formatter, only produces logs in key=val format

Meltano Version
3.2.0
Python Version
3.11
Bug scope
CLI (options, error messages, logging, etc.)
Operating System
Mac OS X, Linux
Description
Using the below http-logging.yaml with meltano el command like so: meltano --log-config http-logging.yaml el tap-name target-name does not produce JSON formatted log messages.
version: 1
disable_existing_loggers: false
formatters:
  json:
    (): meltano.core.logging.json_formatter
handlers:
  http:
    class: logging.handlers.HTTPHandler
    level: INFO
    formatter: json
    host: 'localhost:3000'
    url: '/log'
    method: 'POST'
root:
  level: DEBUG
  propagate: true
  handlers: [http]

When I run the command I get log messages with a body sent to my echo server running that look like this:
name=meltano.cli.elt&msg=%7B%27name%27%3A+%27meltano%27%2C+%27run_id%27%3A+%27424571c7-e70d-4473-a5c8-381fed100276%27%2C+%27state_id%27%3A+%272024-01-23T1
60909--tap-n-target-names%27%2C+%27event%27%3A+%27Extract+%26+load+complete%21%27%2C+%27level%27%3A+%27info%27%2C+%27timestamp%27%3A+%272024-01-23T
16%3A09%3A23.403021Z%27%7D&args=%28%29&levelname=INFO&levelno=20&pathname=%my_path_name$24
hon3.11%2Fsite-packages%2Fmeltano%2Fcli%2Felt.py&filename=elt.py&module=elt&exc_info=None&exc_text=None&stack_info=None&lineno=509&funcName=_run_extract_load&created=1706026163.4030552&msecs=403.0&relativeCreated=14806.555271148682&thread=8064847872&threadName=MainThread&processName=MainProcess&process=73440&_logger=%3C_FixedFindCallerLogger+meltano.cli.elt+%28DEBUG%29%3E&_name=info

Which isn't JSON but also quite hard to parse and noisy. I've double/triple checked this with Logstash running in a docker container on my local machine, and in a pod in an EKS cluster.
Code
No response

Hey @BillyUdders, thanks for logging!
I think this is unfortunately expected from Python's builtin logging.handlers.HTTPHandler. From the docs[^1]:

Since preparing a record for sending it to a web server is not
the same as a generic formatting operation, using
setFormatter() to specify a
Formatter for a HTTPHandler has no effect.
Instead of calling format(), this handler calls
mapLogRecord() and then urllib.parse.urlencode() to encode the
dictionary in a form suitable for sending to a web server.

[^1]: Official docs for logging.handlers.HTTPHandler

Can confirm the above:
import logging
from logging.handlers import HTTPHandler
from urllib.parse import urlencode

record = logging.LogRecord("my_logger", logging.INFO, "/path/to/file.py", 10, "EVENT!", (), None)
handler = HTTPHandler("localhost", 5000)
print(urlencode(handler.mapLogRecord(record)))
# name=my_logger&msg=EVENT%21&args=%28%29&levelname=INFO&levelno=20&pathname=%2Fpath%2Fto%2Ffile.py&filename=file.py&module=file&exc_info=None&exc_text=None&stack_info=None&lineno=10&funcName=None&created=1706751680.052684&msecs=52.0&relativeCreated=8.797883987426758&thread=8648734912&threadName=MainThread&processName=MainProcess&process=39301&taskName=None


RefreshContainer - support pull to refresh on desktop too

Is your feature request related to a problem? Please describe.
Our users expect the same behavior to be available across all platforms.
So even on desktops, they are used to "pull down a list to refresh it"

Describe the solution you'd like
Add some property to the refreshcontainer that allows us to enabpe Pull2Refresh on desktop systems too.
If enabled for desktop, we'd only have to remove the hardcoded conditional in PullGestureRecognizer:

It would look this way and I think this could be interesting to users:

Describe alternatives you've considered
No response
Additional context
No response

I agree it would be great to make this work the same on desktop. However,

WinUI does NOT support pull to refresh on desktop. Avalonia followed upstream WinUI here.
Pointer presses are handled differently. This may be difficult to do.

Thanks for responding! I was also a contributor on Xamarin.Forms back in the days and never got a response anywhere near as fast - if ever!
Regarding 1: Well, maybe we can let the developer decide if he wants to opt in this feature. May be feasible to disable it by default... I don't know.
Regarding 2: Isn't avalonia following WPF "design"?
In WPF, there were "PreviewEvents" that you could hook into. That way, the refreshcontainer would not interfere with the "PointerPressed" event logic of the ListBox item.

In WPF, there were "PreviewEvents" that you could hook into. That way, the refreshcontainer would not interfere with the "PointerPressed" event logic of the ListBox item.

We rarely need preview events. Most of the time (not always) tunnelling events is enough.

I see. But, coming from WPF, [the docs on tunneling events)[https://docs.avaloniaui.net/docs/get-started/wpf/tunnelling-events] do not make things clear to me. I'm sorry.
Can I simply change the PullGestureRecognizer to subscribe to (what is it subscribed to anyways - the parent control of the scrollviewer?) "the thing" using a tunneling approach instead of ho it does it's thing currently?
It would really be great to have the PullGestureRecognizer handle this event before any other part of the UI

Actions that would fall under gestures aren't intuitive when using the mouse, especially when the user expects a refresh button or hotkey. The user wouldn't know that the gesture is available with the mouse pointer, even if it's implemented.

Well... I disaggree - some "not so native" users think that anything that works on a tablet, also works on desktop. They simply cannot differentiate - at least that is our experience.
But I understand your concern.
Could we at least make this "overridable" in the PullGestureRecognizer, so we can cleanly override this behavior?

The user isn't able to provide their own pull gesture recognizer since the code that handles gestures in PullRefresh is internal.
Solving this https://github.com/AvaloniaUI/Avalonia/issues/13645 should make it possible to use touch gestures with mouse.


feat(tutorial): complete step 5 - Cambridge

URL: http://carbon-tutorial-chrisnightingale.eu-gb.mybluemix.net/#/

You can now shut down your BlueMix-hosted site to avoid any potential charges.


Add documentation on content migration/saving pages programmatically

Docs request
When doing a content migration from regular Django models to new Wagtail models, I found very few resources. Saving a Page object programmatically, for example, is not currently documented and best practices are not made available. I touched on this in my Wagtail Space US presentation (link).
Proposal

Add a section to Advanced Topics, possibly called Migrating to Wagtail
Include:

Link to Page model field reference w/relevant explanations of how specific fields are used
Code snippet and example of ideal way to save a Page instance programmatically, including creating the relationship to the corresponding Index page if using
Explanation of how to use the save_revision method and what the difference is between a Page and a Revision in this context
Explanation of how to backdate content, if needed for migration
Explanation of ways to preserve URLs (forcing Page to use existing URL path or saving a Redirect)

Future enhancements

Specific instructions for migrating from Django, Drupal, Wordpress
Links/explanations of strategies for converting content, especially text content, to something Wagtail understands (leveraging StreamFields, for example).

I'm happy to take this on, but do the maintainers think this is a good idea?

#1101 is also relevant re: migrating.

How to migrate to Wagtail is a recurrent question so it might indeed be a good idea to have some documentation.
However we have to be careful on the wording and stress that it is for creating pages programmatically to migrate to Wagtail, not within a Django migration (which is a completely different story).


Using the parsed form parameter 'options' instead of looking for an U…

This fix solves Issue #1757.

@ancore great, thanks a lot! Sorry for the delay in reviewing. Ideally it would be useful to have a unit test demonstrating that the options are recognized in the exporter.

Any possibility to finalize this? Would be much appreciated.

@ancore @nsiebler-dm we'd really prefer to have a unit test which checks for the correct behaviour alongside this change - we always try to add tests when we change code because we have had a history of poor test coverage.
Is there any chance tests could be added to this PR?

@ostephens makes a lot of sense! Merging this then.

@ostephens Correct, more correctly, Stefano added it for Windmill-based UI testing.  Command used on L259 within...
https://github.com/OpenRefine/OpenRefine/blame/95d0cf546d37dc81c493c9ef09e946a7547cd1ba/refine#L256
Original commit here: https://github.com/OpenRefine/OpenRefine/commit/6dbe794658feae7acda9e29a45315b42ece0fa47


Directory support, CWL conformance tests, and CWL workflows

This PR adds:

Directory support for WDL 2.0 and CWL, and secondaryFile support for CWL.
CWL conformance tests as integration tests. These tests are divided into two groups: those that should pass, and those that should fail.
Support for CWL workflows. This is code complete but not yet passing conformance tests.

This PR also includes major changes to the TaskExecutor. Previously, there were multiple entry points for the different task execution stages. Now there is a single entry point, and all the work that needs to be done in bash is done via shelling out to call specific functions in the job script.

@r-i-v-a this PR shouldn't be approved/merged until all the CWL tool conformance tests pass. I'm asking you to start reviewing now because it's a big PR and will probably take a while. Thanks.

I've tried updating the wdlTools version to 0.17.0 (most recent released) https://github.com/dnanexus/dxCompiler/pull/87/commits/6007e2d3cef4bb6d4b74f0250366c05ae02bdcf8
but still seeing the tests fail on looking for 0.15.1-SNAPSHOT for some reason. @jdidion

Branch for testing, based on cwl-conformance
test-2.6.0
Running draft release
https://github.com/dnanexus/dxCompiler/actions/runs/1258133284

Draft release pipeline failed on these tests
Total tests: 353
Failed executions: 4
Tools failed execution:
array_structs
wf_person
runtime_vs_static_type
cwloutput-nolimit
https://github.com/dnanexus/dxCompiler/actions/runs/1258133284 @jdidion

Myriad tests succeeded
https://platform.dnanexus.com/projects/G2054Z80139VJGzy0Kq02PZ1/monitor/analysis/G55V0ZQ0139bQGzj4vVJZYj2
https://platform.dnanexus.com/projects/G2054Z80139VJGzy0Kq02PZ1/monitor/analysis/G55V0Yj0139kFPFg4qV9FpVv
(Based on build when most recent commit was this
commit f927743f91f220d4bc28bbb083f8c6d2270fc23d (origin/cwl-conformance, cwl-conformance)
Author: jdidion<EMAIL_ADDRESS>Date:   Tue Sep 21 11:39:18 2021 -0700
ignore cwloutput-nolimit test)

I think you want val wdlToolsVersion = "0.17.1-SNAPSHOT" @jdidion

yep good catch


Unable to load any page in WallPanel

Describe the bug
Unable to load any page/site in wallpanel. I have tested:

my local Hassio site (http://hass.home)
IP of the hassio site (http://<IP_ADDRESS>)
https://google.com
http://example.com
https://example.com

To Reproduce
Steps to reproduce the behavior:

Go to 'Dashboard URL'
Set to 'https://example.com'
Click 'Dashboard' to load browser'
See: 'Loading 10% http://example.com/
nothing else happens

Expected behavior
The desired site/page to load
Screenshots

Smartphone (please complete the following information):

Device: [Lenovo Tablet M10 (TB-X505F)]
OS: [Android 9]
Version [0.8.7 Build 4]

Additional context
I have tested this on both my home wifi network and my phone's hotspot to ensure that the network wasn't the issue.
I can load all pages/sites listed above in the default chrome browser on the device.

I'm thinking this is probably because of ssl / https support in Android 9.
https://stackoverflow.com/questions/52594637/webview-is-not-loading-page-in-android-9-0
https://developer.android.com/about/versions/pie/android-9.0-migration

I figured out what is happening.
Android 9 implements Chrome as the default webview renderer, except most applications haven't accepted that/made it work/whatever, so they don't load the webview at all.
By uninstalling chrome it forces the default android webview renderer to be used and this works once again. The only issue is now that I don't have access to Chrome, but seeing as this is to be used on the wall, that's not a big deal. I installed a different browser to use the web.
This should probably still be addressed, and at the very least documented for anyone new coming in, as I spent a good number of hours running around in circles trying to understand why this wouldn't work.

I tested on a Google Nexus 5 running Android 10.  I have Chrome browser installed and and loaded https://www.google.com (with its ssl).  I was not able to reproduce your issue.   I do not think there is a connection between having Chrome installed and the application using the Android WebView component.    The WebView component is a separate part of Android.  You can find it on the Google Play https://play.google.com/store/apps/details?id=com.google.android.webview&hl=en.
You may be experiencing SSL issues if you try to load a site that has a self-signed certificate.  That would require the application to manually add your certificate to run.  But loading any site (like google.com) with a certified SSL certificate causes no issues.    Locally you can load HA on your local network if you did not have an SSL self-signed certificate installed.
Looking at the Google Play store, of the 12000 active devices, 2000 of those are running Android 9 or above.  I do not see any crashes or have others reporting this issue.  So this makes me think this issue has something to do with your setup or device. To me this seems like a SSl issue with whatever site you are using.
Possibly as you described in your previous link for Android 9, there needs to be an added value to the manifest in order to run local sites without http, but I have not experienced that issue either.  I can connect to my HA on my local http address without issues, but I do not use SSL on my HA because its running on my local network behind my firewall.
Are you having issues loading google.com when you have the application and Chrome browser installed?   Is the site you are trying to load local with an SSL?

The only update we could make is adding  android:usesCleartextTraffic="true" to the manifest, we obviously cannot add a local domain to the manifest as everyone who uses the application will have a different local domain.   I updated the application to API version 28 and added android:usesCleartextTraffic="true" to the manifest.   After I test this, I will push out an update, as long as this does not interfere with older devices, there should be no issue adding android:usesCleartextTraffic="true", it requires API version 23 or older and the app supports older API, going back to API 16.

Hey @thanksmister thanks for the quick response!
I completely understand it could be specific to the device I am attempting this on. However, I have no other Android device to test this out on.
I know it's not https specific, because I attempted to load http://example.com, https://example.com, and https://google.com all of which either have no ssl, or legitimate ssl certificates. I also do not have a self signed cert or any cert for my local Hassio setup yet, so I know it's not SSL related.
I had issues with multiple apps, not just this one when attempting to load any page in a webview app (Fully kiosk browser, another Kiosk app) and they all acted the same way as WallPanel, the just showed a white screen with no indication of anything happening.
As soon as I disabled Chrome, the fallback Android Webview system immediately began being used and WallPanel is now working perfectly.
Again, all I know is what I have and what action I took and now it is working correctly.

Are you having issues loading google.com when you have the application and Chrome browser installed?

Yes, see above.

Is the site you are trying to load local with an SSL?

No, see above.

we obviously cannot add a local domain to the manifest as everyone who uses the application will have a different local domain

Yea, I totally get that, I wasn't suggesting that needed to happen, I was just referencing some potential items I saw in my research.
Appreciate all your hard work @thanksmister, this app is wonderful!

It seems to me that this is not an application related issue.   We have a lot of Android 9 users and I tested on a stock Android 9 device.   You are having the issue on multiple apps, that is a red flag, it tells me your Lenovo device is the most likely issue and not the apps.   I am not sure how I can address your specific issues with my application.  I do not think that for the majority of users they experience the issue with Chrome and WebView running on the same device.   You might look on Google Play and see if you can update your WebView component.   There is no other component to render webpages inside an Android app.

This is a stock Lenovo device purchased yesterday from Best Buy running Android 9.
It may be just related to this device, but I'd be on the lookout for potential future issues, in case there are steps that need to be taken to be forward compatible.

You might look on Google Play and see if you can update your WebView component.

I did just that, and until I removed Chrome, I was unable to do anything with the WebView component, it simply said 'disabled'.
I'm all good moving forward, you can close this if there's nothing for you to do. Removing Chrome fixed my issue and I'm able to use WallPanel without any issues now.

The issue I have is that the app is already running on 2000 Android 9 devices, so this should have been an issue already, Android 9 has been out for a while.   I imagine your Lenovo isn't running stock Android, that may be something to look at.   I will close this issue for now, but it is here archived for others to find if they run into this issue.  Thanks for all the great input on the issue.


Data editor: change shortcut for 'Set default value'

Currently it is ctrl+insert which clashes with paste command.

Fixed (switched to ctrl+backspoace)

verified


Create opt file for previews

Nicholas can you please show me how to create an opt file for a preview publication?
We don't need this until we start to author in Mauro as we will use the PowerShell script until then.

Opt file can be created but cannot be tested until 3++ is live.

Opt file can be created but cannot be tested until 3++ is live.


Fitting multi-wavelength lightcurves

Another issue I brough up on the starry repo is the ability to fit multi-wavelength lightcurves. With the advent of JWST, I and many others are wanting to simultaneously fit multi-wavelength data. This ends up being such a high-dimensional problem that my understanding is that HMC-based samplers like NUTS are likely the only option. While starry supported wavelength-dependent emission, it did not support wavelength-dependent radii (https://github.com/rodluger/starry/issues/286) or wavelength-dependent limb-darkening (https://github.com/rodluger/starry/issues/310) which are critical for transmission spectroscopy. While with starry one could make N systems for N wavelengths, this ends up being seriously inefficient and slow as the overhead of initializing objects and solving for geometric values (e.g., solving Kepler's equation) is repeated N times.
Again, I am really not well-versed in jaxoplanet yet and its possible that this is already supported, but I wanted to raise this issue early on to try to make sure it was considered before adding such a feature became too cumbersome.

Thanks for bringing this up! This was one of our top motivations for developing jaxoplanet in the first place and it's absolutely supported. Here we benefit from jax.vmap, which means that any models written in JAX can be expressively vectorized over any of their input parameters.
@soichiro-hattori has been leading the work on applying jaxoplanet to real data with a specific eye towards transmission spectroscopy, and we're hoping to have a paper and tutorial "Soon™". In the meantime, we'd be very happy to help get you or anyone else up and running!

Wonderful, I'm very happy to hear it!! :rocket: You're welcome to close this issue if you want or keep it open to avoid others asking the same question until a tutorial is provided


Fit method for CellDiff2Vec is taking extremely long

What
When I am trying to use the fit method of CellDiff2Vec class on a relatively simple Cell Complex, it takes a really long time. It doesn't terminate in even 25 mins. I am not sure what I am doing wrong here. I just wanted to raise this issue, in case any one else is facing the same.

@papamarkou please assign jarpri when he accepts the github invitation.

@ninamiolane sure, @jarpri will give it a go; @mhajij  kindly offered to point Jaro to a couple of relevant web links that will help inspect the matter.

The easiest way to resolve this problem  is to look at the test example that this library is doing :
https://github.com/benedekrozemberczki/karateclub/blob/d750b33e8faaeb95ac2ed6d6ed4f0b470bd506ce/test/neighbourhod_based_node_embedding_test.py#L266
and then generate the correct cell complex accordingly. Our library calls this method since it runs on the example on the test case above then we might have been choosing wrong example to run our algorithm, Maybe it is also worth looking what kind of graphs Diff2Vec accepts as input, there might be some sort of restrictions (connected, or 2 connected or something like that).

@papamarkou @jarpri what is the update on this?


xcode 7 issue? -  non-existent file for the CFBundleExecutable key

Runs fine on the device but submit to app store does not succeed. Please help.
This is the error message I get after app submission using xcode / itunes connect:
Invalid Bundle - Info.plist of “AppName.app/Charts/ChartsTV” specifies a non-existent file for the CFBundleExecutable key...
Invalid Bundle - Info.plist of “AppName.app/Charts/Supporting Files” specifies a non-existent file for the CFBundleExecutable key...
Once these issues have been corrected, you can then redeliver the corrected binary.

Just remove the ChartsTV target from the project and you'll be fine


Issue with server managing logic dashboard

Bug with deleting servers on the dashboard.
The front end doesn't forward the correct ID to the back-end
It works fine for the style="display: none;" forms if you decide to show them.
So how I fixed this was by changing the following data :
onclick="document.getElementById('three').click()"> to   onclick="document.getElementById('<%= server.attributes.id %>').click()">
and                             <input type="submit" id="three"style="display: none;"value="Delete"> to <input type="submit" id="<%= server.attributes.id %>"style="display: none;"value="Delete">

This doesn’t actually explain what the bug is, also your fix (if applicable) would be better as a PR.

It sends the wrong id to the backend and this causes the wrong server to be deleted.


@uirouter/angularjs

Hi all,
With the new version of angular-ui router, we can't now use your trick.
Here what I do:
app.run(['Analytics', '$transitions', '$location', function(Analytics, $transitions, $location) {
    $transitions.onSuccess({}, function(transition) {
        Analytics.trackPage($location.path());
    });
}]);

Is it ok?
How you track params in URL: example => http://localhost:3000/acheter?size=12&page=1&type=false&unused=false&occasion=false&new=false&promotion=false
You send it with Analytics.trackPage($location.url());?

having the same problem as we've just updated the version of ui router. Seems like it would be good to have a new version to accommodate transition hooks in the setPageEvent method.


RotationController should allow to set the rotation axis

The rotation axis of an object is intuitively the surface normal vector of the plane. When changing world rotation of a node, you'd either expect the RotationController to respect that or have the ability to have it changed.

The snippet I'm using is:
    arFragment.setOnTapArPlaneListener(
        (HitResult hitResult, Plane plane, MotionEvent motionEvent) -> {
          if (mCards.isEmpty()) {
            return;
          }

          // Create the Anchor.
          Anchor anchor = hitResult.createAnchor();
          AnchorNode anchorNode = new AnchorNode(anchor);
          anchorNode.setParent(arFragment.getArSceneView().getScene());

          TransformableNode cardNode = new TransformableNode(arFragment.getTransformationSystem());
          ScaleController scaleController = cardNode.getScaleController();
          scaleController.setMinScale(0.01f);
          scaleController.setMaxScale(0.1f);
          scaleController.setSensitivity(0.4f);

          Card firstCard = mCards.get(mLastCardSelectionIndex);
          ViewRenderable.builder()
              .setView(context, getCardView(context, firstCard))
              .build()
              .thenAccept(
                  (viewRenderable) -> {
                    cardNode.setRenderable(viewRenderable);

                    // Change the rotation
                    if (plane.getType() ==  Plane.Type.VERTICAL) {
                      float[] yAxis = plane.getCenterPose().getYAxis();
                      Vector3 planeNormal = new Vector3(yAxis[0], yAxis[1], yAxis[2]);
                      Quaternion upQuat = Quaternion.lookRotation(planeNormal, Vector3.up());
                      cardNode.setWorldRotation(upQuat);
                    }
                  }
              )
              .exceptionally(
                  (throwable -> {
                    throw new AssertionError("Could not load card view renderable.", throwable);
                  })
              );

          cardNode.setParent(anchorNode);
          cardNode.select();
          mLastCardSelectionIndex = (mLastCardSelectionIndex + 1) % mCards.size();
        });

The original issue was that ViewRenderable was "sticking out" of the vertical surface, which doesn't make sense for a view intended to be read. So I changed it's world rotation to be readable to someone looking at the ViewRenderable, i.e. laying it flat on the vertical surface.

The expected axis for rotation controller is the normal "sticking out" of a plane.  This looks different for vertical vs horizontal planes since the normal will be horizontal or vertical respectively.
To get the same behavior between walls & tabletops I might insert a new node as a parent that rotates the axis of rotation from horizontal to vertical when given a vertical plane.  Or you could skip the new parent and directly set the rotation as you did in your code above.
The Transformation System was designed for horizontal user experiences.  We worked closely with our UX designers and researchers to design it in Sceneform 1.0.
As a matter of style, I don't think it translates to vertical tasks without making a lot more changes than changing the axis of rotation.  Updating the UX for vertical interfaces will have to be something we do for a future releases.

Closing due to inactivity.

Please suggest a way to rotate Views on the X and Y axis.


Some porn /broken sites on your index

https://lichess.org/
https://ebass.uk/
https://www.arizonabankruptcylawyer.org
https://holory.fr
http://freyx.co
Found by just randomly clicking around.

What's was wrong with lichess? It's the most well known site on the list and looks fine atm.

Thanks for reporting these sites. I removed them (except lichess, which does nothing wrong IMO) via c4fcbd7.


Login and Sign Up Forms Only Pop Up on Index Page

https://github.com/user-attachments/assets/9d1a162f-3029-4df4-b214-8f5f6d08fd3c
Description:
Currently, the login and sign-up forms are only functional on the index (home) page. These forms should be available on all pages of the website, but they fail to pop up on any other page, making it difficult for users to access them.
Steps to Reproduce:

Navigate to any page other than the index (home) page.
Attempt to open the login or sign-up forms.
Notice that the forms do not appear.

Expected Behavior:
The login and sign-up forms should be available and functional across all pages of the website, not just the home page.
Assign it to me I can work on it, under these Labels. @ANSHIKA-26
Labels: Hacktoberfest, gssoc-extd

Fixed it


Model::Lookup::find_object_location(): only pass the expected three substitution arguments to sprintf()

Description
Make sure that the sprintf() call in line 350 of lib/EnsEMBL/REST/Model/Lookup.pm doesn't receive more than the 3 substitution arguments it expects.
Use case
Previously said sprintf() call was passed the entire @captures array and at least nowadays that array is longer than 3 elements, resulting in a "redundant arguments" warning which spams the output of the test suite.
Benefits
Less noise in test output.
Possible Drawbacks
None I can think of.
Testing
Have you added/modified unit tests to test the changes?
Yes, archive.t - the first test file to have previously produced this warning - now uses Test::Warnings. Note that this adds a new test-time dependency to ensembl-rest, which however shouldn't be a problem because other Ensembl repositories already depend on Test::Warnings.
If so, do the tests pass/fail?
The test passes i.e. no warnings are detected.
Have you run the entire test suite and no regression was detected?
Yes, no regression detected. The errors in archive.t are the same as before with the bugfix branch based on master and gone when based on the branch of #374.

Huh, I could have sworn I described benefits and drawbacks when I created this pull request. Fixed now.

Thanks for finding this bug, it has annoyed me on and off for years.


URIs for submission schema PVs sourced from MIxS have to be rewritten to pass riot validation

The square brackets in <https://example.com/nmdc_sub_schema/EnvBroadScaleSoilEnum#polar+biome+[ENVO:01000339]> are illegal in URIs
See documentation of the enum that contains that permissible value.
<https://example.com/nmdc_sub_schema/EnvBroadScaleSoilEnum#polar+biome+ENVO:01000339> would be acceptable

create issue in linkml/linkml
could solve by creating meanings for the PVs!

or gen-rdf

gen-sparql
shex
shacl


Support App does not get hidden in LaunchPad

The current method to hide the Support App (sudo chflags hidden "/Applications/Support.app) works well for hiding it in the Applications folder, but this does not remove the App from LaunchPad.

Based on my research the easiest way to implement this would be to remove the Support App from the Applications folder.
Might be a good idea to explore installing the App in a /Library/Application Support/Support App directory, similar to swiftDialog (/Library/Application Support/Dialog/Dialog.app)

If not possible or difficult to implement, would it be easier to configure the Support App to open up the app from the system tray when clicked on LaunchPad/Applications Folder?
That way users at least get a visual indicator of what it does.


fix: ensure policies are respected

Ensures that set gas limit and max fee policies take precedence over estimated values.
Checklist

[ ] I have linked to any relevant issues.
[ ] I have updated the documentation.
[ ] I have added tests that prove my fix is effective or that my feature works.
[ ] I have added necessary labels.
[ ] I have done my best to ensure that my PR adheres to the Fuel Labs Code Review Standards.
[ ] I have requested a review from the relevant team or maintainers.

It seems we made gas limit part of the policies even though that doesn't match the specs.
It is convenient to have these knobs all in one place but it might cause confusion if we differ from the underlying system>
It's also a problem when trying to inspect the policies of an executed transaction since we can't easily convert from cores Policy type to our TxPolicies.
We should address this in a future update.


SUDS

adds blog post for SUDS, my major project

Expanding on what @RamZallan said, I think there are two primary angles we should be approaching blog posts from: a description of what the project is/does, and some technical writing on how it's implemented. Describing your role in the project is largely unnecessary in most cases - it's assumed that it's your project and you implemented it. In the case of historical house systems like SUDS (or Harold, or Infosys, etc.), giving some background on history of the project can be useful, but it's still assumed that the post author was the one to do the work. This post should be reworked to cover those two topics more clearly, and remove the portions that don't make sense in that context.


Panic'ed when trying to connect AP

At password page, device panic'ed because of tried to connect already connected AP. Also There is 2 device connected at the same time and not entered ESP_AP closing process, because of some devices disconnected from AP at the same time potentially race condition occured. So, device panic'ed.

Also there is no need for connecting 2 different devices to the esp at the same time.


Implement remote sync resource tagging

IMPORTANT: Where possible all PRs must be linked to a Github issue
Fixes #1509
Checklist

[x] I have written Unit tests for any new feature(s) and edge cases for bug fixes
[x] I have added any strings visible on UI components to the strings.xml file
[x] I have updated the  CHANGELOG.md file for any notable changes to the codebase
[x] I have run ./gradlew spotlessApply and ./gradlew spotlessCheck to check my code follows the project's style guide
[x] I have built and run the fhircore app to verify my change fixes the issue and/or does not break the app

I had a discussion w Elly, where there is a dependency cycle happening.
So currently I'm refactoring that and also several more of his suggestions from our discussion.
cc @f-odhiambo @dubdabasoduba

@pld @dubdabasoduba can we directly merge this?
The main branch CI is failing, that's why this codecov/project coverage is significantly affected.

@FikriMilano Please Update the PR then ping @ellykits and I to get this merged.


Replacing input parameter in ndimage functions

The scipy.ndimage functions frequently use input as an argument to functions. In addition to this being a vague descriptor (what kind of input?), it also overlaps with the builtin input function. It would be preferable to rename this parameter to something that is clearer and does not overlap with Python builtins.
cc @jni @GenevieveBuckley

Same feeling here as for sum in #10593

I'm less clear on how that approach applies here (given we are talking about argument names). Would you be able to clarify things a bit more?

Oh I missed that this had to do with arguments rather than a function name like in #10593.
Sadly there are a lot of instances of overwriting builtins with kwarg names in SciPy. I'm not convinced it's worth the deprecation pain to rename them. We could for example rename them in a backward compatible way like:
def func(x, input_clearer, ..., input=None):
    ...
    if input is not None:
        input_clearer = input

The downside is that it makes the signature a bit uglier.

I'd be :+1: on deprecating these signatures as you suggest, @larsoner. It's nice and pain-free. (iirc SciPy is Py3+ now, which means you could make it a keyword-only argument, which I think is important in this case.)

No, as @larsoner says, this is a common issue in many places. This particular one has been proposed and rejected multiple times. It isn't worth breaking backwards compatibility here, and I definitely would not like to see it done everywhere in scipy, numpy and the wider ecosystem - that'd be a lot of churn for little real-world benefit.

See  #10010.

Good link, @rfezzani. @rgommers et al, I guess this can be closed. I myself have come to accept that this won't be fixed, and that the value of it being fixed is small anyway. =)

Thanks for the input all. Closing.


Add disk-usage sidecar to postsubmits and periodic

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/lgtm

/lgtm
/approve


Add a option to run fully silent

Description of the new feature / enhancement
Currently when PowerToys is running it is shown in the hidden icons arrow. Is it possible to make it run fully silent, not showing even there?
Scenario when this would be used?
It would be useful to declutter the "show hidden icons" menu. As many powerusers run several programs which reside there.
Supporting information
No response

/dup #9526


Allow using prettytable

PTable and prettytable conflict, both using package name 'prettytable'
with one as prettytable.py and the other as prettytable/.
pip provides no protection against two packages conflicting like
these.
PTable hasnt maintained backwards compatability, and hasnt been
doing releases for a while.
This patch allows either to be present.

See https://github.com/jazzband/prettytable/issues/23 for more info.

c.f. https://build.opensuse.org/package/show/home:jayvdb:py-new/python-pip-licenses , where I use a little sed to change setup.py to use PrettyTable instead, and all tests pass.  There is no way that PTable will be acceptable to linux distros, especially given that it is also unmaintained.
If there are no objections to this patch, pls advise if I should use nocover or (much harder..) create a test scenario to cover these new code paths.

@jayvdb Thanks for the patch and information.
I understand that you supported compatibility.
I plan to merge this patch with #51  in the next release.

To make codecov happy, should use nocover or (much harder..) create a test scenario to cover these new code paths?

I have confirmed that it works fine in a pip environment where the prettytable package is installed as an alternative to PTable.
Thank you for great work!

I released as version 1.18.0
https://pypi.org/project/pip-licenses/1.18.0/

Thanks.  Submitted to openSUSE main Python package collection https://build.opensuse.org/request/show/758780


JUnit v4.13.2

Upgrade to JUnit v4.13.1

Closed/re-opened to trigger Travis CI.

@kinow the issue appears to be travis changing the default linux distro, so have created PR #8 which just fixes travis. and rebased this branch from that branch.

Dependabot doesn't appear to pick up junit v4.13.2.


Document connection managers that do (not) support resolvconf

I installed openresolv, and it does not work with NetworkManager because NetworkManager merges all DNS information into a single NetworkManager interface, rather than supplying per-interface information to resolvconf.
I looked at the Debian resolvconf man page, and while the interface naming meaning might differ slightly between the two both definitely support multiple interfaces so this is completely deliberate choice on part of NetworkManager to provide incorrect information.
The question is are there connection managers that do support resolvconf correctly?

The NM issue (unaddressed) https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/issues/153

But the Debian resolvconf does not offer any way to clean up information for multiple interfaces so it's understandable that NM cannot support split dns if it wants to remain compatible with the original resolvconf.

That patently isn't true. Debian resolvconf ships with list-records which shows this.
They have also implemented the -i and -l switches from openresolv recently.
See https://manpages.debian.org/testing/resolvconf/resolvconf.8.en.html

That patently isn't true. Debian resolvconf ships with list-records which shows this.

That's an undocumented binary in lib, and it doesn't do it. Or does not do it in the version that's in Debian stable.

They have also implemented the -i and -l switches from openresolv recently. See https://manpages.debian.org/testing/resolvconf/resolvconf.8.en.html

That's nice but it's not in any released version of Debian. Which means that most people that have the Debian version will not have the ability to list. Sure, Debian has openresolv, and it seems to be the default on new installations.
Still the possibility that users have resolvconf that does not support listing exists, and it was probably the case when the code was written.

And openresolv returns error when using -l and there are no entries so success cannot be even used as indicator of support for the option.

OK, here's the deal. I'm not going to do anything for this. -i and -l aren't really that important to this discussion.
If NetworkManager adds something then it can remember to delete it afterwards. dhcpcd does this when resolvconf isn't present so it's not much of a stretch for it. This is likely why Debian resolvconf took a long time to add this because it's really just a nice to have.


C3D features

Thank you for releasing the code! Could you please point me to the pre-trained C3D model you used for visual feature extraction? What are the hyper-parameters (frame rate, number of frames per clip, stride, etc.) for video pre-processing? Looking forward to your reply!

Dear @fmu2 thank you for reaching out to me. Let me give you more details about the features.

We obtained the features from the official 2D-TAN repository. We did not re-extract the features ourselves.
For ActivityNet-Captions, these features are the same as those released by the official project page (link

Dear @Soldelli Thanks for your excellent work!
I find that ['syntactic_dependencies'] is added into annotations(e.g. train.json) comparing with datasets I have downloaded before. I guess it's generated by Stanford-corenlp. Could you please point out or share the script that you used to generate ['syntactic_dependencies'].
Thanks for your excellent work once more!!!

Hi, @fmu2 I'll look for it and post it here if I find it.
However, I just followed the official documentation.
It should be easy to reproduce.

Here we go.
Get the standford 4.0.0 library version from here.
You will also need to install the pip library: pip install stanfordcorenlp
Then use the notebook attached to this message. (The file is zipped to be shared over this message)
Hopefully it is working properly (haven't touched it in over 2 years), let me know if it is not the case.
Stanford Syntactic Parsers.zip
Cheers

@Soldelli
Thanks for your detailed explanation. I've figured out the process.
Cheers

Hi, @fmu2 I'll look for it and post it here if I find it. However, I just followed the official documentation. It should be easy to reproduce.

Hello, can I only use your annotation files on charades and ANetv1.3 to train on the original data set? If possible, could you please provide a separate JSON file, and also, did you process these three datasets additionally? Thank you so much~


Tab border chars

I made a change to the stylesheet which stylizes the tabs to look like they are created out of ascii characters by using the dotted and double borders. Additionally, the close icons are now unicode X icons to better fit in with the in-terminal theme.

Hi. I appreciate the time and effort you put into this. However, I won't merge it since it's not what I envisioned for this (personal) OSS project, and the PR came suddenly, without an issue beforehand. Feel free to fork and make your own, though.


Fix that virtual NAT session is closed even if data remains.

Changes proposed in this pull request:

Fixed a problem that TCP sessions of virtual NAT will be closed even if the outbound buffer is not empty

Your great patch is much appreciated. We are considering to apply your patch into the SoftEther VPN main tree.
SoftEther VPN Patch Acceptance Policy:
http://www.softether.org/5-download/src/9.patch
You have two options which are described on the above policy.
Could you please choose either option 1 or 2, and specify it clearly on the reply?

one

PRELIMINARY DECLARATION FOR FUTURE SWITCH TO A NON-GPL LICENSE
I hereby agree in advance that my work will be licensed automatically under the Apache License or a similar BSD/MIT-like open-source license in case the SoftEther VPN Project adopts such a license in future.

Thank you very much for your contribution!


Implement model serializers to simplify algo definition

We could define a few serializers in substra-tools to avoid users writing their own.
We could create numpy; json and pickle serializers to start with.
Proposition of API:

class MyAglo(tools.Algo):
    model_serializer = tools.serializers.NUMPY

    def train():
        ...

Note: we should not break the existing API; we should still be able to define manually the load and save methods.

I gave it a try and very rapidly got to something for trivial cases like using Pickle or Joblib but was wondering about more complex stuff like pytorch (for reference: https://pytorch.org/tutorials/beginner/saving_loading_models.html)
Pytorch model are often bundled with an optimizer. In order to save them both, the train method should therefore return both. The trouble I have is that the documentation of the Algo class only says that the train method returns a model object, not a tuple. Also in order to use a model returned by load_model, you'd have to write something like model, optimizer = model.
This feels a bit forced and not easy to understand for users. I think it could be simpler to have Algo subclasses that have different signatures for the train / predict methods. In order to accomodate different signatures, these classes would have to have translate methods that transform args from the basic format to a more specific one.
Do you think this added complexity would be acceptable?

I agree, it's not ideal.
I'm not in favour now to add Algo subclasses, I don't think the complexity is worth it and it would require more thinking (create also subclasses for the openers?). We already have multiple subclasses (Composite, Aggregate and Algo) to handle different use cases and I think we should first try to go back to a single class.

Not a priority now. Would be good.


python setup.py test runs py.test

Think you also need pytest-runner in setup_requires.
ref: https://docs.pytest.org/en/latest/goodpractices.html#integrating-with-setuptools-python-setup-py-test-pytest-runner

LGTM. Thoughts @mrocklin and @jcrist?

Just tried it out locally and it seems pretty nice.  +1 from me

LGTM. Thanks @Horta. Merging.


Vue CLI error

Version
3.0.0-rc.3
Reproduction link
https://www.cannotcreateproject.com
Steps to reproduce
npm install @vue/cli -g
vue create x
What is expected?
A new project setup by the vue CLI.
What is actually happening?
Vue CLI v3.0.0-rc.3
✨ Creating project in D:\Data\demovue\x.
🗃 Initializing git repository...
⚙ Installing CLI plugins. This might take a while...
audited 11991 packages in 17.608s
found 0 vulnerabilities
🚀 Invoking generators...
ERROR Error: Failed to resolve plugin: @vue/cli-service
Error: Failed to resolve plugin: @vue/cli-service
at Creator.resolvePlugins (C:\Users\Vikas Rathee\AppData\Roaming\npm\node_modules@vue\cli\lib\Creator.js:302:15)
at Creator.create (C:\Users\Vikas Rathee\AppData\Roaming\npm\node_modules@vue\cli\lib\Creator.js:145:32)
at
at process._tickCallback (internal/process/next_tick.js:188:7)

Node : v8.11.3
Windows 10 version 10.0.17134

Duplicate of #1604


How to call commonJS version?

after update, find-cache-dir package causes error on my typescript project.
How do i import CommonJS of this package through typescript ?

https://gist.github.com/sindresorhus/a39789f98801d908bbc7ff3ecc99d99c


E_OAUTH_TOKEN_EXCHANGE: Error: getaddrinfo ENOTFOUND graph.facebook.com graph.facebook.com:443

Hi! Thanks for providing such great project.
Has anyone encountered this kind of error?
E_OAUTH_TOKEN_EXCHANGE: Error: getaddrinfo ENOTFOUND graph.facebook.com graph.facebook.com:443

The error throws after this line of code
const fbUser = yield request.ally.driver( 'facebook' ).getUser();

Seems like some connection issue. It is still happening?

Hi! I've managed to figure this out. It seems that our network blocks all facebook request so that is why I'm getting that exception.
I'm closing this issue now.
Thanks.


[Snyk] Security upgrade yaml from 2.1.3 to 2.2.2

This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to fix one or more vulnerable packages in the `yarn` dependencies of this project.
Changes included in this PR

Changes to the following files to upgrade the vulnerable dependencies to a fixed version:

bridge/server/package.json
bridge/server/yarn.lock

Note for zero-installs users
If you are using the Yarn feature zero-installs that was introduced in Yarn V2, note that this PR does not update the .yarn/cache/ directory meaning this code cannot be pulled and immediately developed on as one would expect for a zero-install project - you will need to run yarn to update the contents of the ./yarn/cache directory.
If you are not using zero-install you can ignore this as your flow should likely be unchanged.
Vulnerabilities that will be fixed
With an upgrade:

Severity
Priority Score (*)
Issue
Breaking Change
Exploit Maturity

768/1000  Why? Proof of Concept exploit, Recently disclosed, Has a fix available, CVSS 7.5
Uncaught Exception SNYK-JS-YAML-5458867
No
Proof of Concept

(*) Note that the real score may have changed since the PR was raised.
Check the changes in this PR to ensure they won't cause issues with your project.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
🛠 Adjust project settings
📚 Read more about Snyk's upgrade and patch logic

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.

Keptn V1 has reached EOL on December 22nd, 2023, so this PR has been closed.


refactor test framework

submit multiple schemas in one call
apply retry logic for 500 series error code

This issue was moved to informatics-isi-edu/ErmrestDataUtils#2


Serialize to type hinted response type first?

See here:
https://sqlmodel.tiangolo.com/tutorial/fastapi/relationships/#models-with-relationships
My example code
class StrategyWithPortfolios(StrategyWithCategory):

    portfolios: list[Portfolio] = []

@router.get("/all")
@cache(expire=60)
async def read_strategies(
    session: Session = Depends(get_session),
) -> list[StrategyWithPortfolios]:
    """
    get all Strategy
    """
    stmt = (
        session.query(Strategy)
        .options(
            joinedload(Strategy.portfolios).options(joinedload(Portfolio.investors))
        )
        .options(joinedload(Strategy.category).load_only(Category.name))
    )
    ret = stmt.all()
    ret = [StrategyWithPortfolios.model_validate(r) for r in ret]  # very important!!!!!
    return ret

The returned result is sqlalchemy orm class Strategy but the data structure I want to return is StrategyWithPortfolios.
The code works well without the line ret = [StrategyWithPortfolios.model_validate(r) for r in ret]  and @cache(expire=60).
But if I add @cache(expire=60) it save fields only belong to Strategy not portfolios nor Category to redis.
Please serialize the returned result to given pydantic model before save it to backend.

Late to the party, but if you add:
@router.get("/all", response_model=list[StrategyWithPortfolios])

In addition to keep the result annotation (->list[StrategyWithPortfolios]:) it seems to work. Also needed for the openapi.json to report the correct result type (instead of juststr).
Tested on FastAPI version 0.115.0.
Would be super nice if the worked without having to specify response model twise.


Append new authorized user to blossom-ci whitelist [skip ci]

Add new user to blossom ACL.

build

build


Generate OSB UUIDs instead of having the operator provide

As @duglin suggested here, creating these UUIDs is an onerous thing for operators to have to. We should generate these for them.

Actually, upon further investigation, we are already doing this.

Actually, upon further investigation, we are already doing this.

What makes you say that?

https://github.com/kubernetes-incubator/service-catalog/blob/master/pkg/controller/handler.go#L110-L112

Just to wrap up this thread...
@pmorie and I discussed and agreed that managing these defaults needed to become an API responsibility, but that in the meantime (for as long as the controller watches TPRs instead of API types), we can leave the equivalent functionality in the controller as well.
See #334


Memory leaks in new parts of the API

It looks like there are a few memory leaks / asymmetries in code recently added to the API:

BNGetArchitectureRegisterStackName and BNGetArchitectureIntrinsicName appear to be called without ever freeing the returned strings
BNGetAllArchitectureRegisterStacks and BNGetAllArchitectureIntrinsics don't even have corresponding free functions. This may not matter in the Python API where these are called in Architecture.__init__, but in my own code I'm stuck calling BNFreeRegisterList to free the intrinsics list, because the types happen to match up.

Small update to mention that BNGetAllArchitectureIntrinsics does need to get fixed (leaving open because of that), but the rest are not actually leaks because of the way the wrapper generator works.

Rusty fixed this in the middle of a recent refactor.

To expand slightly, BNGetArchitectureRegisterStackName (and other API calls that return strings) immediately duplicate the string from the core and then free it -- this happens in _binaryninjacore.py transparently, so there is no leak.


[zh-cn] sync daemonset.md

content/zh-cn/docs/concepts/workloads/controllers/daemonset.md

/approve


Stim compatibility

Construct qiskit-qec CodeCircuits based on stim circuits.

PR merged: Stim compatibility #405


⚠ Bofrost.at has degraded performance

In 805284c, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1737 ms

Resolved: Bofrost.at performance has improved in 44ed3ca.


bugfix: secondary_gids ignored in acces point creation

what

Check for additional GID when creating a access point
Access point example added

why

The secondary_gids was ignored

/test all

/test all

/test all

/test all

/test all

/test all

/test all

Thanks for your contribution! This has been released as version 0.32.0.


fix the typo #79

Fixed the typo: "monthly" to "hourly"

This pull request is merging to master. I will close this and recreate the pull request. But will merge it straight away now

please don't merge I have not approved it yet there are changes needed

ok

From: saeed sadri<EMAIL_ADDRESS>Sent: 05 February 2021 09:47
To: MetOffice/PyPRECIS<EMAIL_ADDRESS>Cc: Maalick, Zubair<EMAIL_ADDRESS>State change<EMAIL_ADDRESS>Subject: Re: [MetOffice/PyPRECIS] fix the typo #79 (#85)
This email was received from an external source.   Always check sender details, links & attachments.
please don't merge I have not approved it yet there are changes needed
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHubhttps://github.com/MetOffice/PyPRECIS/pull/85#issuecomment-773921639, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AN2CPNCA4IXWMOQDBW4EFQDS5O5BRANCNFSM4XC66EOA.

sorry I got confused with tutorial 1 changes this is good to go


Feature request: Alphabetically sort mods

I noticed that mods aren't alphabetically ordered in their own sections, can they be alphabetically ordered?

Done with https://github.com/affederaffe/BeatSaberModManager/commit/b25e4f6d979d46f0658cf916b8b9ccabc232abf7.


Objective-C Library broken from sync_posix.c

#3496 brought this up, but it broke in a different location from testing. This is happening during normal usage of the gRPC library. See attached screenshot for info, I can provide more context if necessary.

Looks like https://github.com/grpc/grpc/issues/3364 resurrected?

I should mention this is building from google3. If this is indeed #3364, were the fixes ever applied to google3?

Not reproducible on GitHub.


Object is not parceled correctly if it has a field of an array of its own type

Consider this example class:
public class Example {
    private Example[] array;
}

After generating the parcelable code, we get:
public class Example implements Parcelable {

    private Example[] array;

    @Override
    public int describeContents() {
        return 0;
    }

    @Override
    public void writeToParcel(Parcel dest, int flags) {
        dest.writeParcelable(this.array, flags);
    }

    public Example() {
    }

    protected Example(Parcel in) {
        this.array = in.readParcelable(Example[].class.getClassLoader());
    }

    public static final Parcelable.Creator<Example> CREATOR = new Parcelable.Creator<Example>() {
        @Override
        public Example createFromParcel(Parcel source) {
            return new Example(source);
        }

        @Override
        public Example[] newArray(int size) {
            return new Example[size];
        }
    };
}

writeParcelable should be writeTypedArray
readParcelable should be createTypedArray
This issue seams to be in ParcelableSerializerFactory.getSerializer() where the psiType of the class we're currently working on has not yet implemented the Parcelable interface.

A fallback to writeTypedArrayfor unidentified arrays would probably work. You'll get a compile time error if it's not a parcelable. Or, to be safe, writeParcelableArray, to handle objects of different types in the array.


If inventory project exists, update project and sync sources

Use the new functionality to update existing inventory-only projects in infra-ansible:
Relates to: https://github.com/redhat-cop/infra-ansible/pull/627

@paulbarfuss or @oybed can y'all help me understand if this functionality has been released?   we have been facing an issues with out inventory - from git project - not updating when a job template with that inventory runs...

@paulbarfuss or @oybed can y'all help me understand if this functionality has been released? we have been facing an issues with out inventory - from git project - not updating when a job template with that inventory runs...

Hello @jf229 thank you for reaching out. Yes, this was a small piece of automation that was released several years ago and illustrates just one way to solve updating inventories from an SCM project.
Could you please open a new issue if this question is directly related to this repo? Otherwise, if you have general questions and are looking for support about configuring Ansible Tower/Automation Platform I would direct you to our Red Hat support teams for help with your use case.
Thanks!


Cryo Pulls: Hide them and add button to show them

Add a toggle button in the header to show pulls with the Cyrogenic Storage label. Hide them by default.
Also, add a flag for these pulls.
Flag when the label is present:

Header button:

Closes #252

@danielbeardsley I see that this pull includes the same commits that are in Columns pull https://github.com/iFixit/pulldasher/pull/255, was the intentionally?

was the intentionally?

It's built on that branch... but I forgot to force-push something. Now it's all good.

CR :goat: through 93df43d
deploy_block :+1: on comment.

CR 🌵

CR 🌵

CR :goat: through 35ba36c

QA 🎬

Cryo pulls are hidden by default
Cryo pulls can be toggled


feat: Facebook Token Credentials using Type-Safe Middleware

Introduces a TypeSafeFacebookToken protocol which implements the TypeSafeCredentials and TypeSafeMiddleware protocols, that can be passed to a user's Codable Routing handler representing a user authenticated using a Facebook OAuth token.
A default implementation FacebookTokenProfile has been provided, which serves as a sample, or can be used as-is if the user does not want to further customize their type.
The requirements of a type-safe Facebook token middleware are:

The type must conform to TypeSafeFacebookToken, which itself conforms to Codable. Any properties must therefore be Codable.
The type must be a struct or a final class. The class must be final because the TypeSafeMiddleware protocol includes a static function with a Self type reference.

When defining a conformance to TypeSafeFacebookToken, the user must define:

id: String representing the (app-scoped) unique identifier for a subject,
name: String representing the subject's display name,
a static appID: String property, which represents the Facebook OAuth client id ('AppID').
additional properties may be declared matching the available fields from the Facebook user profile API. Examples of such properties, including use of convenience structures mapping to the data provided by Facebook, are included in the FacebookTokenProfile.

An example declaration:
import CredentialsFacebook

// Defines the user's session instance data.
struct MyFacebookToken: TypeSafeFacebookToken {
    let id: String
    let name: String
    let email: String?
}

// Defines the configuration of the user's type
extension MyFacebookToken {
    static let appID: String = "1234567890"
}

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@84140bc). Click here to learn what that means.
The diff coverage is 36.52%.

@@            Coverage Diff            @@
##             master      #41   +/-   ##
=========================================
  Coverage          ?   14.68%
=========================================
  Files             ?        4
  Lines             ?      286
  Branches          ?        0
=========================================
  Hits              ?       42
  Misses            ?      244
  Partials          ?        0

Flag
Coverage Δ

#CredentialsFacebook
14.68% <36.52%> (?)

Impacted Files
Coverage Δ

...es/CredentialsFacebook/TypeSafeFacebookToken.swift
36.52% <36.52%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 84140bc...2eea2b1. Read the comment docs.


Fix/1285 short answer title

Description

Creates underline component
Creates shortAnswerFormatter function and test file
Update QuestionListItem component
Adds react-string-replace package to project

Issue(s)
Fixes #1285
How to test

Go to {cloud link}
Click on _______
You should see _______

Screenshots
How it used to look (delete if n/a):

How it should now look:

Checklist

[x] Added or updated tests where appropriate
[x] Manually tested across browsers / devices
[x] Considered impact on accessibility
[x] Design sign-off
[x] Approved by product owner

:tada: This PR is included in version 1.182.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Discussion: Use Expecto for test project

I guess everyone knows my opinion about "traditional" .Net test frameworks, and noticed that I'm big fan of Expecto. ;)
But there are some real advantages:

Promoting community based solution
Promoting "idiomatic" F# way
Removing problems with Assembly Redirects that everyone has with test frameworks using external runners

Already did this in my fork

Now covered by https://github.com/fsprojects/ProjectScaffold/issues/325


🐛 [BUG]: CustomNodeProps' incorrectly extends interface 'NodeProps

Is there an existing issue for this?

[X] I have searched the existing issues and this is a new bug.

Current Behavior
Hi, I am trying to reproduce this block of code from the documentation:
<script lang="ts" setup>
import type { NodeProps, NodeEventsOn } from '@vue-flow/core'

// define your events
interface CustomNodeEvents {
  click: NodeEventsOn['click']
  customEvent: (input: string) => void
}

interface CustomNodeProps extends NodeProps<any, CustomNodeEvents> {
  id: string
  events: CustomNodeEvents
}

const props = defineProps<CustomNodeProps>()

props.events.click(() => {
  console.log(`Node ${props.id} clicked`)
})

// custom events are just functions, they are not hooks which you can listen to like `click`
props.events.customEvent('custom event triggered')
</script>

However, I am facing this type error:
Interface 'CustomNodeProps' incorrectly extends interface 'NodeProps<any, CustomNodeEvents, string>'.
  Types of property 'events' are incompatible.ts(2430)
interface CustomNodeProps

Expected Behavior
A working app when choose

You don't need to re-define click in your custom events, it's already a default one and you're not overwriting it seemingly.
You don't need to re-define emits in the props, by doing so, you forcibly overwrite the prop from NodeEventsOn<CustomEvents> to your own interface CustomNodeEvents type. If necessary use NodeEventsOn<CustomNodeEvents> as the type for emits.

<script lang="ts" setup>
import type { NodeProps } from '@vue-flow/core'

// define your events
interface CustomNodeEvents {
  customEvent: (input: string) => void
}

interface CustomNodeProps extends NodeProps<any, CustomNodeEvents> {
  id: string
}

const props = defineProps<CustomNodeProps>()

props.events.click(() => {
  console.log(`Node ${props.id} clicked`)
});

props.events.customEvent('foo');

and you're good to go, I'll update the pinia example at some point :)


added task.run to help executing subtasks

The idea is to be able to run subtasks in the same way we run tasks. See the test for an example.

+1