adding microsoft.eventgrid/namespaces,microsoft.eventgrid/partnernamespaces,

Related command
az network private end connection related commands
Example:
az network private-endpoint-connection list --id {PrivateLinkResourceID}
Description
This change is to add support for private end connections for new resource type Microsoft.EventGrid/namespaces, Microsoft.EventGrid/partnerNamespaces
Testing Guide
N/A
History Notes

Thank you for your contribution! We will review the pull request and get back to you soon.


is there any reason to use turbodbc with Postgresql? vs psycopg2

I didn't see anywhere in the documentation why one should use turbodbc for postgresql or mysql... it seems to suggest that native drivers are better than odbc and psycopg2 is a native driver?

Hi there! For PostgreSQL, reasons to use turbodbc are limited as the official PostgreSQL ODBC driver is very slow. The turbodbc documentation suggests psycopg2 and asyncpg as quicker alternatives.
Turbodbc just gives you the fastest ODBC based alternative when there is no native driver or the native driver does not perform well. Native is not necessarily better, as it depends on the amount of love that has been put into it.
I have heard of turbodbc users that prefer turbodbc over alternatives for MySQL, though I have no benchmark results to support that.

Thanks its clear now. I had seen that  documentation,but it confused me...I
thought it meant that psycopg2 also provided an odbc wrapper which one
could use with turbodbc, and then it was fast...
Sean
On 5 Oct 2017 9:07 pm, "Michael König"<EMAIL_ADDRESS>wrote:

Hi there! For PostgreSQL, reasons to use turbodbc are limited as the
official PostgreSQL ODBC driver is very slow. The turbodbc documentation
http://turbodbc.readthedocs.io/en/latest/pages/databases/postgresql.html
suggests psycopg2 and asyncpg as quicker alternatives.
Turbodbc just gives you the fastest ODBC based alternative when there is
no native driver or the native driver does not perform well. Native is not
necessarily better, as it depends on the amount of love that has been put
into it.
I have heard of turbodbc users that prefer turbodbc over alternatives for
MySQL, though I have no benchmark results to support that.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/blue-yonder/turbodbc/issues/132#issuecomment-334562395,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADJxLwQ6dIPVW0vPkWeE_U4uYi6UY5rOks5spSjTgaJpZM4Pvec-
.


Add support to customize the recovery plans for vRealize Automation

Code of Conduct

[X] I have read and agree to the project's Code of Conduct.
[X] Vote on this issue by adding a 👍 reaction to the original issue initial description to help the maintainers prioritize.
[X] Do not leave "+1" or other comments that do not add relevant information or questions.
[X] If you are interested in working on this issue or have submitted a pull request, please leave a comment.

Description
Develop PowerShell cmdlet(s) to enable customization of the recovery plans for:

vRealize Automation cluster

Use Case(s)
Provides an automation path for the procedure.
Potential Configuration
To be determined during implementation.
References
Guidance: Customize the Recovery Plan for vRealize Automation

VMware Site Recovery Manager 8.6 adds REST APIs. For more information, see this blog.

Duplicate of #62

Consolidating.


Possible exploit via .update()

Knex version: 1.03 and 1.04
Database + version: 10.5.9-MariaDB-1:10.5.9+maria~buster
OS: Debian GNU/Linux 10 (buster)
Hello,
I've found that the following results in an update to 'two':
const rogue = { one: 123, two: 456 };
const test = await knex('testing')
  .update('one', rogue)
  .where('id', 1);

Reproducible on a table like:
CREATE TABLE `testing` (
  `id` int(11) NOT NULL,
  `one` int(11) NOT NULL,
  `two` int(11) NOT NULL
);

Possible exploit/security issue?
Adding toString() outputs
update `testing` set `one` = {"one":123,"two":456} where `id` = 1

That's not valid SQL, but the actual query according to general_log is
update `testing` set `one` = `one` = 123, `two` = 456 where `id` = 1

Thanks

Thanks for the issue, I push a fix just now. I will check later if other statements have that kind of possible exploit.

Related: https://flattsecurity.medium.com/finding-an-unseen-sql-injection-by-bypassing-escape-functions-in-mysqljs-mysql-90b27f6542b4

Released in 1.0.5


attempt to improve handler developer docs (#3148)

Pull request opened by the merge tool on behalf of #3148

Merged into branches iso4 in cada42f85fbaf4216b8c218d21540c707f88c14c


EPIC: Push/Pull Mempool

This is a placeholder issue as we flesh out what the push pull mempool will look like.
In order to increase our block size, we will need to dramatically increase tendermint's p2p stack efficiency. There are many different things that we could do this, one proposed mechanism is to have the mempool gossip transactions and rollup block data like normal the first time a node sees that data, but then only gossip hashes should that tx or blob stay in the mempool. If a peer recieves a hash of a tx or blob that it has not seen before, then it can request the data for that hash from the peer who sent the hash. This functionality would be needed for #883.

Update: I have a working prototype of this on feature/cat which builds off v1.5.0.... The current specification can be found here. I intend to start working on some performance benchmarks to compare this mempool with the priority mempool (v1) in v1.5.0.../v0.10.0 (app).

Synced with @Bidon15 on the analysis gameplan. Since testground doesn't yet support metrics, I've modified the mempool reactors to dump all relevant metrics to a JSON file in the data directory every 10 seconds. I've verified that this is working with the e2e tests (simple 4 validator network run for ~12 minutes). Comparing the v1 (prioritized mempool) with v2 (content addressable transaction pool) will give us the following data:
v1 (validator02)
{
"StartedAt":"2022-12-15T13:30:23.70262411Z",
"EndedAt":"2022-12-15T13:42:53.771855021Z",
"FailedTxs":0,
"EvictedTxs":0,
"SuccessfulTxs":741,
"AlreadySeenTxs":1130,
"SentTransactionBytes":3428100,
"SentStateBytes":0,
"ReceivedTxBytes":3494090,
"ReceivedStateBytes":0
}

v2 (validator03)
{
"StartedAt":"2022-12-15T13:15:34.843873053Z",
"EndedAt":"2022-12-15T13:27:44.880283237Z",
"FailedTxs":3,
"EvictedTxs":0,
"SuccessfulTxs":704,
"AlreadySeenTxs":4,
"SentTransactionBytes":1163337,
"SentStateBytes":79548,
"ReceivedTxBytes":1076671,
"ReceivedStateBytes":79674
}

Here each tx is 1kb. With testground, we will initially be testing a 100 validator network with 1000 clients mostly using PFB/Blob txs. The test will span roughly 10 minutes.
The main gain from the content addressable transaction pool that we expect are reductions in bandwidth consumption. While this in itself is appealing to validators, we should measure the impact such bandwidth reductions have on the following baselines:

transaction throughput (This is roughly the bytes agreed upon per 100 validators per second)
transaction latency (The mean time between transaction submission and finalization)
block production variance (standard deviation as well as range in block times. This is often influenced by timeouts under load. We need to ensure that the network makes progress reliably even under load)

can this issue be closed as completed with the introduction of CAT pool?

Yes, the CAT pool has been now implemented so I think we can close this as being completed


MBP.hideUrlBar() executes if addEventListener is undefined

As documented on https://gist.github.com/1183357#gistcomment-52884, the hideUrlBar() function is buggy. It will evaluate even if there is no windows.addEventListener function is present.

@caillou thanks :) this has been updated with the latest hide url bar script


[Code Highlight] Add csharp language support

I followed the guide https://theme-ui.com/packages/prism, did the shadow components.js but it did not work.
Please correct me if I'm wrong!

I tried various options, first of all, I tried to do this:
Create the components.js file here (in the existing gatsby-plugin-theme-ui folder)
src/gatsby-plugin-theme-ui/components.js
And import there import 'prismjs/components/prism-r'
But nothing came of this (I tried adding prism.r.js to different places), then I tried different other options. But, I'm afraid this is not something that can be implemented "out of the box", I think that in order to implement this, we need to add new Chronoblog functionality.
But I'm not so sure! Perhaps there is a way about which I do not know.

Thanks for your efforts. I'm new to gatsby, I'll try to find another way!

we only need do shadow gatsby-plugin-theme-ui/components.js like this

Then update styles.code at gatsby-plugin-theme-ui/index.js like this

I think we should add this way to readme file

Great job 👍! Yes, it is definitely worth adding to the readme. I think it will be better if you do it (since this is your contribution).
I already added information about Prism in the readme, I think it should be posted somewhere here: https://github.com/Chronoblog/gatsby-theme-chronoblog#adding-support-for-additional-programming-languages
Only, I think it will be better if instead of screenshots, you place the code there.


Add more GitHub.com shortcuts

Added more github.com shortcuts.
Added (not replaced) [subject][verb] versions of commands.

Updated according to remarks.


docker hub

I think it would be nice and help a lot people if the image would be available in the docker hub https://hub.docker.com/ is it planned to add it here?

I was concerned about the licensing: this is why I only shared the instructions and not the resulting docker image.
I checked the license in the CCU2 firmaware image and I only find references to the included open source, not an specific license. I also did not have to accept any licenses when downloading the firmware image. Therefore I will assume that I can re-distribute the docker image to docker hub.
I will modify the docker image to detect the type of board at runtime instead of buildtime and also include the license. Then I will upload to docker hub.

Uploaded at https://hub.docker.com/r/angelnu/ccu2/


Add legal country for set and not-set membership proofs

Purpose
The browser wallet calls the verifySetStatement function to exclude all the attributes not allowed for these types of proofs. The LegalCountry attribute (from company IDs) has been added recently. Propagating this addition to the SDK.
Related: https://github.com/Concordium/concordium-browser-wallet/issues/484
Related: https://github.com/Concordium/concordium-base/pull/542
Changes

Add legal country for set and not-set membership proofs

It seems all checks passed? When will the chrome ext be released for testnet?

Dear @nhs-it,
the web-sdk version 8.1.0 has been released now with the above changes:
https://www.npmjs.com/package/@concordium/web-sdk
We are working on the browser wallet release that includes web-sdk version 8.1.0.

Dear @DOBEN - any update on the browser wallet using web-sdk 8.1.0 - on testnet?

@nhs-it
We are testing and preparing the browser wallet release at the moment.
https://github.com/Concordium/concordium-browser-wallet/pull/526

@nhs-it The new browser wallet Version 1.7.1. This wallet include company ZK proofs now since the web-sdk has been updated.
https://developer.concordium.software/en/mainnet/net/release-notes/release-notes-lp.html#bw

Great! thank you


Flow treats async as a reserved word—is it?

Here is an example:
scratch.js
/* @flow */

import {succeed, async} from "./src/task"

stdout
scratch.js:3
  3: import {succeed, async} from "./src/task"
                      ^^^^^ Unexpected token async

ES2015 has await as a reserved word that can't be used as an identifier. http://www.ecma-international.org/ecma-262/6.0/#sec-reserved-words

Woah, is it really possible that the Async Functions proposal doesn't carve out async as a new reserved word?
@jeffmo I don't see anything in the proposed spec. Missing something?

fixed by #1858


Add More Tests For Broadcast Operations

In operations_broadcast_test.go there are some tests that are not yet filled in. The point is to test that broadcasting works for different shapes. The semantics of broadcast probably isn't clear, so please do send me a message for anything.
This is a good first issue for anyone looking to get interested

I'm volunteer for this issue, my skills in ML is very low and I want to improve them.

FYI the API for broadcast operations are now autogenerated in the next branch.

Is this issue still available?

Yes!

In the new branch (golgi-supports) you will see all the autogenerated APIs. It'd be good to test those

Thanks. I'll take it if @blackrez doesn't want it.

If @evanmcclure want to work on it, it's ok for me.
Actually, I'm busy with my new project based on gorgonia. :simple_smile:

@evanmcclure Is this still open ?

@supun The answer is yes.  If you want, you can tackle the rest of the operations. The tests will most likely fail, but I will still merge them if they fail in the correct way.
I am currently working on the concrete semantics of broadcast. Once that's done, all the failing tests should pass


winsdk 10.0.17025.0, error : left of '->return_value' must point to class/struct/union/generic type

using namespace std::chrono;
    winrt::IAsyncOperation<int> GetAsyncOp()
{
	using namespace winrt;
	using namespace abi;

	for (int i = 0; i != 5; ++i)
	{
		co_await 5000ms;
	}

	co_return 1;
	//return 1;
}

This was related to MIDL_CONST_ID is defined incorrectly, leading to linker errors
https://developercommunity.visualstudio.com/content/problem/141665/midl-const-id-is-defined-incorrectly-leading-to-li.html


old versions

A quick question:
My mac book crashed a month ago, so i cant continue to work on my scenario right now. I did make a backup but it will take a while until i can use it, because its in another town.
My question: Are you going to delete the downloadlinks for older versions of valkyrie anytime soon or do i not have to worry about that? Im a little bit in fear of some compatibility-issues, because my last save will be on much older valkyrie-version.

Firstly:
Have a look here:
https://github.com/NPBruce/valkyrie/wiki/QuestFormat
For supported versions.  Unless you are using a version from before 1.1.0 the current release will still support your files.  Just resave to update your scenario, while there is a chance of bugs you will need to do this at anyway to update for release.
Secondly:
The only builds I have removed are very old (before 0.5.7).  If I do remove any others it will only be prereleases and/or builds with known serious bugs.  The labelling system before 1.0.0 is a bit messy, so I might remove more of those old builds to clean things up, but I really hope you aren't using a pre-stable build anyway.
Hope this helps.

it does! thank you!


cannot parse from string?

here is my code:
#include <stdio.h>
#include<stdlib.h>
#include <nlohmann/json.hpp>

using json = nlohmann::json;

int main(int argc, char **argv){

// create object from string literal
// parse explicitly
std::string text = "{ \"happy\": true, \"pi\": 3.141 }";
auto j = json::parse(text);

std::string str = j.dump();

printf("j=%s \n", str);

printf("happy=%d, pi=%f \n", j["happy"], j["pi"]);

return 0;
}

this is build:
g++ -Wall -std=c++14 -I./json/include -L./json/lib test4.cpp -o t4
and result:
./t4
j=
happy=25431392, pi=0.000000

For printf's %s, you need to provide a char pointer:
printf("j=%s \n", str.c_str());

In general, the mixture between the class and C-style code may need additional casting.
Could you try:
printf("happy=%d, pi=%f \n", j["happy"].get<bool>(), j["pi"].get<double>());

Or just use std::cout << "happy=" << j["happy"] ...

The library does not perform implicit conversions such as from string to numbers.


Modified the node sku

Hi,
With the original SKU Standard_DS1_v2 we now get the following error:
"Operation failed with status: 'Bad Request'. Details: System node pool must use VM sku with more than 2 cores and 4GB memory. Nodepool name: nodepool1."
With the SKU Standard_DS2_v2 it works.

Same issues as @nwipfli but i used Used D2s_v3 with no issue.


Build failure: Blender with CUDA

Steps To Reproduce
Steps to reproduce the behavior:

Install blender with:

pkgs.blender.override { cudaSupport = true; };

Build log
error: builder for '/nix/store/bpyj55jlj444jv7z8b4b8b95bx8xv021-openimagedenoise-2.2.2.drv' failed with exit code 2;
       last 10 log lines:
       > [ 79%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/cpu_device.cpp.o
       > [ 81%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/cpu_image_copy.cpp.o
       > [ 81%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/cpu_engine.cpp.o
       > [ 82%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/cpu_pool.cpp.o
       > [ 83%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/cpu_upsample.cpp.o
       > [ 84%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/tasking.cpp.o
       > [ 85%] Building CXX object devices/cpu/CMakeFiles/OpenImageDenoise_device_cpu.dir/cpu_conv.cpp.o
       > [ 86%] Linking CXX shared library ../../libOpenImageDenoise_device_cpu.so
       > [ 86%] Built target OpenImageDenoise_device_cpu
       > make: *** [Makefile:156: all] Error 2
       For full logs, run 'nix log /nix/store/bpyj55jlj444jv7z8b4b8b95bx8xv021-openimagedenoise-2.2.2.drv'.
error: 1 dependencies of derivation '/nix/store/z01h8bg6ad60xcbrlhipfx8ckcqadx5k-blender-4.1.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/k2z7n4z8rpiblzm01y6ikry6k6alzgqw-home-manager-path.drv' failed to build
error: 1 dependencies of derivation '/nix/store/ga947fk01r3n5k79gd1rn78h315dwpyb-home-manager-generation.drv' failed to build
error: 1 dependencies of derivation '/nix/store/wvdrwg0nvg9k3kddidb39qd9haf1h2ip-user-environment.drv' failed to build
error: 1 dependencies of derivation '/nix/store/l33x6ziqzf047xm53a1fcic51jsyc6ln-etc.drv' failed to build
error (ignored): error: cannot unlink '/tmp/nix-build-nvidia-x11-550.67-6.8.4.drv-1/NVIDIA-Linux-x86_64-550.67/kernel': Directory not empty
error: 1 dependencies of derivation '/nix/store/bcdxphgr5dvznjindh13w2hzi6v1j0ag-nixos-system-bender-24.05.20240408.4cba8b5.drv' failed to build

Here you can see the logs for OpenImageDenoise:
[ 73%] Performing configure step for 'OpenImageDenoise_device_cuda'
loading initial cache file /build/source/build/devices/cuda/tmp/OpenImageDenoise_device_cuda-cache-Release.cmake
-- The CXX compiler identification is GNU 13.2.0
CMake Error at /nix/store/mbw6qprvn80p8k7z3lq44hnz6b332xf6-cmake-3.28.3/share/cmake-3.28/Modules/Internal/CMakeCUDAFindToolkit.cmake:3
7 (message):
  Could not find nvcc executable in path specified by
  CUDAToolkit_ROOT=/nix/store/m784c2rsx1gz5aj3lzy32k4rd5m1iv5g-cuda_cudart-12.2.140-dev;/nix/store/6wrzb2nldjw8rm9q2yvlwk53wb2hl2dn-cu
da_cccl-12.2.140-dev;/nix/store/677gn3v8lga776iv3ncqpw94l2f3xvq8-cuda_nvcc-12.2.140-dev
Call Stack (most recent call first):
  /nix/store/mbw6qprvn80p8k7z3lq44hnz6b332xf6-cmake-3.28.3/share/cmake-3.28/Modules/CMakeDetermineCUDACompiler.cmake:89 (cmake_cuda_fi
nd_toolkit)
  CMakeLists.txt:17 (project)

-- Configuring incomplete, errors occurred!

Additional context
Something similar seems to have been mentioned here.
Notify maintainers
@goibhniu @veprbl
Metadata
λ ~/ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.8.3, NixOS, 24.05 (Uakari), 24.05.20240403.fd281bd`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.2`
 - channels(root): `"nixos-23.11"`
 - nixpkgs: `/nix/store/n2g5cqwv8qf5p6vjxny6pg3blbdij12k-source`

Add a :+1: reaction to issues you find important.

I'm seeing something with cuda-toolkit maybe related in nixpkgs-unstable/ollama?
error: builder for '/nix/store/g9dda5xggh2lpz464d1fsyf6285l5b3i-cuda-toolkit.drv' failed with exit code 1;
       last 3 log lines:
       > warning: collision between `/nix/store/3csipjn30fjsa4lmxj68pb7wp1cbg6yn-cuda_cudart-12.2.140/LICENSE' and `/nix/store/hqvwymsafsxvrnlwn7jyhdmjj4m5c9c6-cuda-merged-12.2/LICENSE'
       > created 391 symlinks in user environment
       > rm: cannot remove '/nix/store/qlm47mx7h7r31l4gwrzimb1bik38k3y4-cuda-toolkit/lib64': No such file or directory
       For full logs, run 'nix log /nix/store/g9dda5xggh2lpz464d1fsyf6285l5b3i-cuda-toolkit.drv'.
error: 1 dependencies of derivation '/nix/store/ca49n10z082walb1p3zk3rcq3c2i2k6n-ollama-0.1.31.drv' failed to build
error: 1 dependencies of derivation '/nix/store/r3vka882rnynb0fb10vf849b6dh8dmiy-system-path.drv' failed to build
error: 1 dependencies of derivation '/nix/store/9ax36sjn7x37h2vmd2j06jg1i8ar8p01-unit-ollama.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/adngv55zrwchpdanbwrz35lx8c39x840-nixos-system-io-23.11.20240417.e402c3e.drv' failed to build

nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.8.5, NixOS, 23.11 (Tapir), 23.11.20240411.51651a5`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.1`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Cannot replicate on latest nixos-unstable (66adc1e). Fixed in (I believe) #302845.

That's right. I can confirm that Blender 4.1 builds fine now with Cuda support on latest version of nixpkgs unstable.

@mevatron, I'd filed a separate issue for that here: #305583
Please add any additional information you might have there.

@mevatron, I filed a separate issue for that here: #305583
Please add any additional information you might have there.

Oh, thanks! You beat me to it! 😄


Actually GC cache items when we collect the LRU.

Pass the cache root's version to LRU collect after the get and set operations have finished mutating the cache. Fixes #507. cc: @michaelbpaulson @sdesai @jhusain

Sorry about the delay.
This looks fine to me, although I did want to verify I'm understanding updateNodeAncestors correctly:
It seems like we're relying on it to removeNode, with this change, and it will, starting at the sentinel/leaf (the first iteration of the do/while loop, when child.$size === offset) and then we'd continue up, either removing branches as their sizes are zero'd out, or updating version references (and size) if they're not.
Also, what's the use case for calling collectLRU without a version?
@michaelbpaulson - If you have a chance, can you look it over, since you filed the original issue.
I'm thinking of cherry picking it into the 0.x branch, to pull it into the next patch release I'm pushing to npm.

+1

Just a heads up: Had to tweak the test a little when cherry-picking to 0.x, since 0.x didn't need to strip the internal deref keys before asserting [ 0.x has the 0.x deref ]


Different name?

The main feedback on https://news.ycombinator.com/item?id=28986762 was that "flatmap" is ambiguous and not unique. Before publishing to maven central, package managers, etc should decide whether or not to keep "flatmap" or use something different.
Pros:

easier to find through search.
It's still early so there are too many inbound links yet

Cons:

there are still some links, forks, and stars so need to be careful to preserve those

Any suggestions?

Idea: "velotile"

https://github.com/onthegomap/velotile
docker run ghcr.io/onthegomap/velotile
maven: com.onthegomap.velotile:velotile-core
package: com.onthegomap.velotile.Main

Idea: "Global￼ Tile Engine (gte)"

https://github.com/onthegomap/gte
docker run ghcr.io/onthegomap/gte
maven: com.onthegomap.gte:gte-core
package: com.onthegomap.gte.Main

I agree that "flatmap" isn't a spectacular name for what this project is doing, but all my ideas are rather plain:

mapbuilder
vectorbuild
tilebuilder

Yeah, naming is hard :-)  It seems like a minor detail, but I am holding off on some things like publishing to maven central, and adding an OSM wiki entry until I nail down a name to stick with.
I'm leaning towards:

something that conveys the main value proposition of the project (fast planet vector tiles)
maybe something outdoors/running/biking related to tie it back to on the go map

Leaning away from:

"map" in the name - saying onthegomap/flatmap out loud is a lot of "maps"
something random unrelated to what it does (I love the mapzen projects, but it's sometimes hard to navigate things named after norse mythology)
something with "j" or "java" in the name (I suspect most people will use this as a tool, not a library so the fact that it's written in java is inconsequential)
something tied to how it works (like "stripe" from the stripe clipping algorithm) since that may change

Probably going to go with nanotiler
https://github.com/onthegomap/nanotiler
docker run ghcr.io/onthegomap/nanotiler
maven: com.onthegomap.nanotiler:nanotiler-core
package: com.onthegomap.nanotiler.Main

What's the nano part, breaking work into small chunks?

Personal significance, and (relatively) tiny resource requirements for building planet-scale vector tilesets from OpenStreetMap.

Nano makes me think small, this project is more fit for a name like Gigatiler! Or what about Planetile/Planetiler?

Ooh I like planetiler - and I see nothing with a similar name on google search.
https://github.com/onthegomap/planetiler
docker run ghcr.io/onthegomap/planetiler
maven: com.onthegomap.planetiler:planetiler-core
package: com.onthegomap.planetiler.Main

Just want to avoid confusion that its "planet-tiler" not "plane-tiler" (should be obvious from repo description) and if you remember the name that it's only spelled with one T.

How about globetiler?
Less confusing and still covers what it does.
And I can't see anything else that uses that name.

I like the portmanteau of planetiler, but yeah I guess it could also be read as plane-tiler. Though that's also sortof accurate too, right? Like it can tessellate the earth with vector tiles?

Yeah I'm leaning toward planetiler, the "planet" part should be obvious from the repo description and if the plane part would be a throwback to flatmap.

Planetiler it is! Updated the repo and published v0.2.0 version this morning. Thanks all for the feedback and @danlarkin for the name suggestion!


Work with global variables

This PR https://github.com/facebookresearch/faiss/pull/1917 added methods for global variables
This feature is not released yet

a new native faiss release https://github.com/facebookresearch/faiss/releases/tag/v1.7.2


Copying a blocks page to a subsite does not copy blocks

If a blocks page includes draft/saved/published blocks, when copying to the page to a subsite through 'Subsite Operations' function, the expected result is the page and the containing blocks are copied to the subsite. Current behaviour copies the page but does not include the saved/published blocks.
Probably related: #418

We probably need to implement recursive duplication. I think subsites has some of its own logic for duplicating across subsites, I refactored some of it recently. It should be using the recursive duplication logic from core as much as possible though. It's also possible that this is fixed with an unreleased version of subsites, need to check.

Done @robbieaverill https://github.com/silverstripe/silverstripe-subsites/issues/393


Adding standard license and code of conduct from k6

Fixes #11
Signed-off-by: javaducky<EMAIL_ADDRESS>

AGPL for a js library seems like a ... not great idea :thinking:

🤔 ... @mstoykov looking at some of our other JS libs, we've either omitted the license or have the MIT license in the case of k6-jslib-formdata. @sniku any thoughts on this from your side as well?


Low priority VSCODE issues

Does restarting work?

Check this out https://github.com/motdotla/dotenv/issues/475

Had the same issue, came across the same thread, did not find a resolution.

Is it causing any issues? Or is it just a warning in the Problems tab?


Sidebar transparency effect

This PR adds a transparency effect to the sidebar, as long as system and app brightness match.
Some changes to MainFlutterWindow.swift are necessary, like they were done in the README and the example
Pre-launch Checklist

[x] I have run dartfmt on all changed files
[x] I have incremented the package version as appropriate and updated CHANGELOG.md with my changes
[x] I have added/updated relevant documentation
[x] I have run "optimize/organize imports" on all changed files
[x] I have addressed all analyzer warnings as best I could

Before PR

After PR

This should close #173.

Thank you, I just changed it according to your suggestion.


modify grammar

您发给我的邮件已经收到。This is an automatic reply, confirming that your e-mail was received.Thank you

I have read the CLA Document and I hereby sign the CLA

I have read the CLA Document and I hereby sign the CLA

recheck

recheck

recheck

CLA Assistant Lite bot: Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.
I have read the CLA Document and I hereby sign the CLA
You can retrigger this bot by commenting recheck in this Pull Request

recheck

recheck

Hi @zr-182 ,
I find the changes are committed by @IIIImp . Please double-check your git settings.
Thanks.

Hi @6fj ,
I added new commits under your advice . Please check if they r OK .
And , as you said , the first commit is from @IIIImp . I forgot to change the git account but now I have changed it. I wonder if it is all right.

I have read the CLA Document and I hereby sign the CLA

recheck


Update the blurb on channelData

ChannelData is present even in personal conversations with the bot. It does NOT include team-id and channel-id in that case, but it still includes the tenant-id.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ae6b8c5f-dbce-1020-f97d-873c19a097e5
Version Independent ID: b7906ada-45a3-4fd7-23fa-656ed00550e3
Content: Send and receive messages with a bot - Teams
Content Source: msteams-platform/resources/bot-v3/bot-conversations/bots-conversations.md
Product: msteams
GitHub Login: @surbhigupta
Microsoft Alias: lajanuar

Hi doc team, It looks like channeldata is present even in personal conversations with the bot. It does not include team-id and channel-id but it still includes the tenant-id. Could you please help us to update the content accordingly.

@siduppal -  Could you please confirm if this is what you are asking to remove?
"channelData": {
"tenant": {
"id": "72f988bf-86f1-41af-91ab-2d7cd011db47"
}
https://docs.microsoft.com/en-us/microsoftteams/platform/resources/bot-v3/bot-conversations/bots-conversations#full-inbound-schema-example

Hello doc team,
We got a confirmation from engineering team and they said that this statement
The channelData object is not included in messages in personal conversations since these take place outside of any channel. is incorrect and should be removed from the documentation.
NOTE -  ChannelData is present in all activities sent from SMBA to bots for Teams scenarios and it always contains TenantId in it.

@surbhigupta12 - Could you please help us to update this document?


docs: add progress-bar component

Adds documentation for Progress Bar component.
A couple notes:

Currently (v7.41.0), the component has one accessibility violation which is tracked over in the main repo: https://github.com/carbon-design-system/carbon/pull/9479. The accessibility docs refer a future version (7.42.0) in which this bug has been fixed and released, assuming that this documentation PR will take longer than the bug fix. This can obviously be changed if that's not the case.
Live Demo is missing. I couldn't get it to work as docgen couldn't pick up the component. Perhaps this is due to the current unstable status of the component?

Changelog
New

Adds documentation for the Progress Bar component

Closing in favor of #2688


Bug Fix: Model Name Should Not Be Verified Through OpenAI with Custom Endpoint

Closes #331
Overview
This Pull Request aims to fix the bug that prevents setting custom API endpoint.
Background
Many open-source LLMs (e.g. FastChat, ChatGLM) provides OpenAI-compatible APIs, which means once these models are set up and running locally, users should be able to query them, still via openai.ChatCompletion.create(),  simply by setting export OPENAI_API_BASE=<where model is running>. However the current version of GPT-Engineer attempts to verify model name through OpenAI even if a custom api base is set.
Changes

Modified such that model name is only verified (by fallback_model()) only if a custom OPENAI_API_BASE is not set.

Thanks @JinchuLi2002 !
The only problem with this is that the collect_learnings will not use the right model name if we move the fallback here.
To address, could for example use ai.model.
Question though: How do you propose we get the right model name when setting other OPENAI_API_BASE than the default?
Would love to merge this if we can solve this!

@AntonOsika
Hi Anton, thanks for the reply! :D

For your first point, could you be more specific how the issue could rise? The only impact with me moving fallback_model() with regards to collect_learnings() is that it could allow a non-OpenAI model name to be passed to the latter, if a custom end point is set. Do you mean that send_learning() would mandate the model name sent to be a OpenAI model?
Sadly, I don't think there's an effective way of verifying the model name with a custom endpoint. Because it differs with the local models which the user deploys. For example, the model name is 'codegen' for FauxPilot and 'vicuna-7b-v1.3' for Fastchat

Should we maybe do whatever langchain does to standardize model selection?

@AntonOsika For LangChain I don't think they have a standardized model selection mechanism either. For openai models, it's defaulted to 'text-davinci-003' (source), and for google_palm model, it's straight up model_name: str = "models/text-bison-001" (source) and it's for the users to make sure the model_name is set correctly.

Hey there are a few things that would be needed to merge this:

Consider using OpenaiChat as a field of the AI class: https://github.com/hwchase17/langchain/blob/1f4a51cb9c84c6a061cda729c4cdd3783d98922c/langchain/llms/openai.py#L659
Pass in the base into AI, not get it from env variable

I think there is another PR that looks at this

thanks @AntonOsika !
will open a separate PR after I do more research


Duplicate symbols when installed via Homebrew

objc[31962]: Class _TtCs18_EmptyArrayStorage is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs24_ContiguousArrayStorage1 is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs17_CocoaSetIterator is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs24_CocoaDictionaryIterator is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs17NonObjectiveCBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs17_stdlib_AtomicInt is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs19_SwiftNativeNSArray is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs24_SwiftNativeNSDictionary is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs17_SwiftNativeNSSet is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs24_SwiftNativeNSEnumerator is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs18_SwiftNativeNSData is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs26_SwiftNativeNSCharacterSet is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs31_stdlib_ReturnAutoreleasedDummy is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs20_SwiftNativeNSString is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs19_NSContiguousString is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs40_SwiftNativeNSArrayWithContiguousStorage is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs21_SwiftDeferredNSArray is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs27_ContiguousArrayStorageBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs14_VaListBuilder is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtCs13VaListBuilder is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSError is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class SwiftObject is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftValue is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNull is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSArrayBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSDictionaryBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSSetBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSStringBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSEnumeratorBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSDataBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSCharacterSetBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftNativeNSIndexSetBase is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftCore.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC8Dispatch16DispatchWorkItem is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftDispatch.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftDispatch.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC10Foundation15NSSimpleCString is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC10Foundation16NSConstantString is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC10Foundation25NSFastEnumerationIterator is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC10Foundation25_NSErrorRecoveryAttempter is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC10Foundation20_SwiftNSCharacterSet is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _TtC10Foundation12_SwiftNSData is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.
objc[31962]: Class _SwiftTypePreservingNSNumber is implemented in both /usr/local/Cellar/pxctest/0.2.1/libexec/PXCTestKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib and /Applications/Xcode.app/Contents/SharedFrameworks/SourceKit.framework/Versions/A/Frameworks/libswiftFoundation.dylib. One of the two will be used. Which one is undefined.

I'm still seeing this with pxctest, even when using --HEAD with Homebrew.

I just installed using

brew tap plu/pxctest && brew install pxctest

and still seeing:
objc[61825]: Class _TtCs18_EmptyArrayStorage is implemented in both /usr/local/Cellar/pxctest/0.3.3/libexec/Frameworks/PXCTestKit.framework/Versions/A/Frameworks/libswiftCore.dylib (0x10dece990) and /Applications/Xcode.app/Contents/Frameworks/libswiftCore.dylib (0x11160a990). One of the two will be used. Which one is undefined.


Update: Display layer view state

Description: This PR updates Display layer view state sample. Redesigned the UI and added state handling to reflect the latest API design, as well as refactor the code to adapt these changes.
Old branch: https://github.com/Esri/arcgis-runtime-samples-ios/blob/philium/readme-updates/arcgis-ios-sdk-samples/Maps/Display layer view state/README.md
New Branch: https://github.com/Esri/arcgis-runtime-samples-ios/tree/Ting/Update-LayerViewDrawState-vNext/arcgis-ios-sdk-samples/Maps/Display layer view state
Ref:

/runtime/common-samples/issues/2120
/runtime/common-samples/issues/2016

Demo

Active
Out of Scale

Not Visible
Warning

@vquach2404 Could you please review this PR? Then I'll review it after that.

I tested the sample on an iPad and about 5 seconds after launching, this warning appeared. Maybe we should adjust the scale accordingly for iPads?

Ha sorry for that... 😅  I copied the scale from Android and apparently they don't have larger screen devices. Will zoom in further on load.

The changes look good! Ready for @philium 👍🏼

I thought we were going to hold off on merging to v.next until the README updates are merged?


Extend testing

The bulk of the unit testing at the moment is validation of the pyrealm predictions against the predictions of other implementations. The test suites need more simple tests checking that the basic classes and functions work as intended - clearer checking of failure modes.

Start to add tests when errors come up, add unit tests

Split tests into unit tests vs regression/integration tests?

Closing as done.


create forum where we can discuss features and get help

I have a few questions in regards to drag and drop but can't find a forum to discuss them. gitter.im could be a good place

There is already a gitter or just use stackoverflow :smile:


Convenience string(...) method on ResponseBody to strip BOM

So response.body().string(true) will return a string without the BOM.
This helps avoid a lot of boilerplate code just for handling BOMs, in every app that uses OkHttp.

I think #2707 will solve this automatically. All calls to string() will be BOM-free once that is implemented.

A BOM, by its nature and definition, shouldn't be exposed to the consumer in the char world. Only the byte world (aka source() or byteStream()).

Tell that to Sun... :)
It's been a month, I thought maybe there are complexities that delay the merge, so I've added a simple function to handle this at least for the string().
If the other one is getting merged for sure, feel free to close this. I hope that this will at least help people coming here looking for a temporary solution, it's a copy-paste function...

I think we want this API. I’m not completely convinced we want to do it here and not in Okio, but this is a good start.
Can you confirm that this is 100% original code written by you, and complete our CLA?
https://github.com/square/okhttp/blob/master/.github/CONTRIBUTING.md

Yes, this is completely written by me. Not too complex, I think :)

And done!

I don't want this API. This is providing the user a choice when there is no actual choice needed. Just make string() do the Right Thing™. If you want a BOM-containing string then use source().readUtf8(). charStream() also should do the Right Thing™.

Yup, I'm convinced. Let's just eat the BOM in string() and charStream(). If you want it, you do your own InputStreamReader.

Yeah, I thought so too, just didn't want to do introduce any breaking changes. Then I realized that if anyone has considered BOM in their code, they must have done so conditionally.
I've modified the code and rebased.

I've just fixed a typo in my commit, but I see that you have a bigger solution prepared here for chartStream as well.

Just a heads up I submitted #2823 earlier this morning.


Optimize make request

!test

Codecov Report

Merging #322 into master will decrease coverage by 0.17%.
The diff coverage is 57.69%.

@@            Coverage Diff             @@
##           master     #322      +/-   ##
==========================================
- Coverage   58.43%   58.26%   -0.18%
==========================================
  Files          41       41
  Lines        3544     3534      -10
  Branches      414      411       -3
==========================================
- Hits         2071     2059      -12
- Misses       1371     1376       +5
+ Partials      102       99       -3

Impacted Files
Coverage Δ

core/utils/network_utils.py
62.74% <47.05%> (-2.75%)
:arrow_down:

vmmaster/webdriver/__init__.py
87.75% <50%> (-3.92%)
:arrow_down:

vmmaster/webdriver/commands.py
66.48% <85.71%> (+0.35%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 966ee55...963c750. Read the comment docs.

!test


Remove 'ctx' from Secp256k1-py.

I got an error when installing with module secp256k1 existing.
AttributeError: module 'secp256k1' has no attribute 'ALL_FLAGS'
Here is the commit from 7 months ago that removed the need for a context:
https://github.com/rustyrussell/secp256k1-py/commit/833c0f5ad24029704f6a7ad30065c9d426476a81

Thanks for this.
I'm surprised it was needed, since I thought that I used this terrible copy of pybitcointools so that it wouldnt have to use any external dependency including secp256k1. We can probably just delete all the secp256k1 things entirely.
By my reading the only place that library is even used is for de/serializing bip32 keys and for the old-style electrum deterministic wallet. The library used to be used a lot more before we started using Bitcoin Core's descriptor wallets to generate addresses.
I'll most likely not use this but instead see if I can get rid of that library entirely. (But it will be in uh.. several months, my schedule is like that these days)

Hi,
I don't know if this module is still needed, but at least it gets imported.
Yes, I think removing dependencies is the best solution.


Freezing parameters for transfer learning

In optax, there is a function .multi_transform which can be used to apply different optimization functions to different parameters in a model. In particular, it's possible to tell the optimizer to not update gradients of certain parameters. This way, one could e.g. freeze a backbone of a pre-trained model during transfer learning.
Is there a similar functionality in opax? How to freeze model's backbone and train only its head?

In optax, there is a function .multi_transform which can be used to apply different optimization functions to different parameters in a model. In particular, it's possible to tell the optimizer to not update gradients of certain parameters. This way, one could e.g. freeze a backbone of a pre-trained model during transfer learning.
Is there a similar functionality in opax? How to freeze model's backbone and train only its head?

What is needed, is a function following the conventions from transform.py, e.g. like this one: https://github.com/NTT123/opax/blob/main/opax/transform.py#L28
We want to have a different scaling of gradient updates for different parts of the network. I dealt with it by keeping the modules which the network consists of (backbone and head) in a dictionary:
class TransferResnet(pax.Module):
    def __init__(self, backbone, head):
        self.module_dict = {"backbone": backbone, "head": head}
    def __call__(self, input):
        x = self.module_dict["backbone"](input)
        x = self.module_dict["head"](x)
        return x

This way, the module names will be present in a pytree so we can reference them in a function jax.tree_util.tree_map_with_path.
I wanted to freeze the backbone parameters at the first stage of training and unfreeze at a later stage so I went for a function:
def multi_transform(schedule_fn: Callable[[jnp.ndarray], jnp.ndarray]):
    count: jnp.ndarray
    backbone_multiplier: jnp.ndarray

    class MultiTransform(GradientTransformation):
        def __init__(self, params):
            super().__init__(params=params)
            self.schedule_fn = schedule_fn
            self.count = jnp.array(0, dtype=jnp.int32)
            self.backbone_multiplier = self.schedule_fn(self.count)

        def __call__(self, updates, params=None):
            del params
            self.count = self.count + 1
            self.backbone_multiplier = self.schedule_fn(self.count)

            updates = jax.tree_util.tree_map_with_path(
                lambda path, u: self.backbone_multiplier * u if "backbone" in jax.tree_util.keystr(path) else u, updates
            )
            return updates

    return MultiTransform

My schedule function is very simple, returning 0 for first backbone_lr_steps steps, and 1 afterwards:
def lr_backbone_schedule(step):
    return step > backbone_lr_steps

The only thing which is left, is adding the function to an optimizer:
optim = opax.chain(
        opax.add_decayed_weights(weight_decay),
        opax.sgd(lr_schedule, momentum=0.9),
        multi_transform(lr_backbone_schedule)
    ).init(transfer_model.parameters())


[hotfix][docs] Fix typo in datastream api

What is the purpose of the change
Fix typo

@rmetzger CI success, PTAL

Thanks


Use vendoring tool dep instad of committing the vendor folder

The repository already contains Gopkg.toml and Gopkg.lock but the vendoring folder is committed in codebase.

update Gopkg.toml and Gopkg.lock to use the last version of packages (see
2b7d2a2)
introduce dep as vendoring tool in CI and build process (see 1fa718f)
remove /vendor folder from repository (see f174d07)

I still using dep since is the tool used in this repo but maybe we should consider to move to module when go1.11 will be released

too late, but: afaik most projects commit vendor, because the pros are stronger than the cons: https://github.com/golang/dep/blob/master/docs/FAQ.md#should-i-commit-my-vendor-directory
just my 2 cents :)

@slintes I agree with you

I was on the same site when deciding to commit it in. I merged that PR as I am not that experienced with the go ecosystem at all and it made sense at that moment.
So I would do a little vote here, at least @mavimo @JohnnyQQQQ @JohnnyQQQQ, maybe @eliasp
React on this comment with

:+1: if you feel including the vendor dir is better, or
:-1: if you feel excluding the vendor dir as of this PR is better

addition: if we choose to commit it back, I still would like to have that in an extra PR, as the updates to the Gopkg files were needed anyway

@JohnnyQQQQ sorry :P
I mean we should not commit vendor dependency into the project repository, but should managed as dependency like other language/technology (eg: mvn for Java, composer for PHP, npm for Javascript, ...).

https://getcomposer.org/doc/faqs/should-i-commit-the-dependencies-in-my-vendor-directory.md
https://dev.to/tommym9/should-you-commit-your-vendor-folder-to-git-2kae
https://medium.freecodecamp.org/an-intro-to-dep-how-to-manage-your-golang-project-dependencies-7b07d84e7ba5

Duplicating the vendor code in our project is an anti-pattern that IMHO should not be done in any project.

2 of the 3 the con arguments of getcomposer (history duplication, git submodule problems) are not relevant because go dep doesn't add the .git directory of dependencies into the vendor directory.
And the best pro argument is coming from the javascript/npm world: when someone deletes a project you depend on, you still have the code and can compile, until you find a replacement (https://www.theregister.co.uk/2016/03/23/npm_left_pad_chaos/).
(but at the end I don't care that much, this topic only catched my eyes while cleaning up my github notification mails)

Never thought about someone deleting a whole project I depend on :fearful:


#613: Use latest dicedb tag instead of 0.0.2 in docker-compose.yaml file.

Fixes: #613

Updates the image to latest from 0.0.2 in docker-compose.yaml file in examples/leaderboard-go.

Looks like these changes already exist in the latest master.


up_squared_adsp:running tests/kernel/workq/work_queue/ failed

Describe the bug
running test/kernel/workq/work_queue/ error, it showed assertion failed.
To Reproduce
Steps to reproduce the behavior:
sanitycheck -W -p up_squared_adsp  --device-testing -T tests/kernel/workq/work_queue/ --west-flash="/home/ztest/work/zephyrproject/zephyr/boards/xtensa/up_squared_adsp/tools/up_squared_adsp_flash.sh, /home/ztest/work/sof/rimage/keys/otc_private_key.pem" --device-serial-pty="/home/ztest/work/ambient/set_ambient /home/ztest/work/zephyrproject/zephyr/boards/xtensa/up_squared_adsp/tools/mbterm.py" -x=CONFIG_IPM=y -x=CONFIG_CONSOLE=y -x=CONFIG_LOG_PRINTK=n
see error
PASS - test_triggered_wait

===================================================================
START - test_triggered_wait_expired
Starting triggered test
- Initializing triggered test items
- Submitting triggered test items
- Submitting triggered work 1
- Submitting triggered work 2
- Submitting triggered work 3
- Submitting triggered work 4
- Submitting triggered work 5
- Submitting triggered work 6
- Checking results (before timeout)
- Running triggered test item 1
- Running triggered test item 2
- Checking results (after timeout)
Assertion failed at WEST_TOPDIR/zephyr/tests/kernel/workq/work_queue/src/main.c:133: check_results: (num_results not equal t
o num_tests)
*** work items finished: 2 (expected: 6)
- Running triggered test item 3
- Running triggered test item 4
- Running triggered test item 5
- Running triggered test item 6
FAIL - test_triggered_wait_expired
===================================================================
Test suite workqueue failed.
===================================================================
PROJECT EXECUTION FAILED

Environment (please complete the following information):
OS: Fedora28
Toolchain: Zephyr-sdk-0.11.3
Commit ID: 2cd556a689

Could you re-test? I could not reproduce it on master and on the commit you provided.

Yes, I reproduce issue on this commit.


Add the DISABLED state to form controls

TS pull requrest: https://github.com/angular/angular/pull/10994
TS Design Doc: https://docs.google.com/document/d/1k_iYcgTS1cDJkyXvBWQZGPlkWZhEqAVphC0xyKSAqPs/edit

IMHO this is also related to added support for form reset (I thought that there used to be an issue open for form reset but I can't find it atm).

Yes, it is. Both have been added to the 5.0 milestone, as I'm planning to work on both in the next few weeks.

Nice! Is there still an issue that can use to track the progress of form reset?

https://github.com/dart-lang/angular/issues/216

This is now supported, via a [ngDisabled] attribute. There were too many existing, conflicting usages of [disabled] to support that directly.
See https://github.com/dart-lang/angular/commit/3ca1de175d213986d4733aedb2025e9b37c3e262 for an example of how to use it.


What's difference between systemjs & es6-module-loader

While searching for dynamic import ES2015, I came across https://github.com/systemjs/systemjs/ and es6-module-loader
Both seems to be serving similar purpose. Wondering what is the difference between them?
Cross posted issue.

Closing, as this is double-posted.


no serial log output on uart4

Very happy with your help, I can compile normally and run blink on milkv-duo, but I don't see zephyr serial port running log output on uart4(GP2/GP3).
Is there any problem with my operation? I'm using the release image https://github.com/kinsamanka/milkv-zephyros/releases/download/v0.1.1-alpha/milkv-duo_sdcard.img.gz
Could you please give me some help?
Thank you very much!

There is output.
The image contains a blinky sample, please try that.
Try using a different uart adaptor, some cannot handle 115200 baud (try lowering the speed here). Sometimes restarting the secondary processor also works.


Scan PR Changed Files For "random"

This PR created for solving https://github.com/EC-KitY/EC-KitY/issues/4

@itaitzruia4 Hey, can you please take a look at this?

@itaitzruia4  ? :)

Closing this but keeping the branch. Feel free to reopen it if still relevant.

Sorry for not replying, can you show us it works by tests or in another way?

Sorry for not replying, can you show us it works by tests or in another way?

I can't write tests for this or run this action because it opened from a forked repo. However, I can show you this:
The main logic of this action is the following code:
git diff HEAD..origin/main | grep -i -n "random" > detections.txt
if [ -s detections.txt ]; then
  cat detections.txt
  echo "RANDOM_DETECTED=true" >> $GITHUB_OUTPUT
fi

Open a branch called test from main.
Create/Edit a file, and include the word random somewhere in it.
To simulate a local run, run the above code, replacing $GITHUB_OUTPUT with  env.txt.
You will get a similar output to this:

--> meaning the word random was detected, thus leading to a comment on the PR.

The best way to see it is to merge this PR, and then open a new PR to main with the word random it - you'll see the alert immediately.


⚠ Mobitopup has degraded performance

In f451006, Mobitopup (https://napcard.voz.tech) experienced degraded performance:

HTTP code: 200
Response time: 3098 ms

Resolved: Mobitopup performance has improved in e9cdbd1.


i2Connect DateTime from MS SQL Server

Use of toJSDate and/or toISOString is not giving the correct result in javascript/typescript.
I have tried different methods and different selects from SQL Server but does not get the correct result.
Are there any suggestions on how to use the methods to get the correct result?

Hi,
Our SDK does  give some information here:
i2 Connect Data Namespace
Have you had a look at the w3schools  reference here :
JavaScript Date Formats
JavaScript Date Objects
They might help you figure it out.
Cheers


WIP- Average aggregators takes an average of all leaf values

Hoist P/R Checklist
Pull request authors: Review and check off the below. Items that do not apply can also be
checked off to indicate they have been considered. If unclear if a step is relevant, please leave
unchecked and note in comments.

[X] Caught up with develop branch as of last change.
[X] Added CHANGELOG entry, or determined not required.
[X] Reviewed for breaking changes, added breaking-change label + CHANGELOG if so.
[X] Updated doc comments / prop-types, or determined not required.
[X] Reviewed and tested on Mobile, or determined not required.
[X] Created Toolbox branch / PR, or determined not required.

If your change is still a WIP, please use the "Create draft pull request" option in the split
button below to indicate it is not ready yet for a final review.

Pull request reviewers: when merging this P/R, please consider using a squash commit to
collapse multiple intermediate commits into a single commit representing the overall feature
change. This helps keep the commit log clean and easy to scan across releases. PRs containing a
single commit should be rebased when possible.

Think we should try to get this right and into a release ASAP, Hoist Avg Agg is being used in a soon to be released client app.


COPY INTO Error: Not able to validate external location because The remote server returned an error: (403) Forbidden.

Question
Hello there,
The MS documentation page   states that there is no limitations on the number of files (PARQUET,ORC) to load into Synapse (SDW) dedicated pool. However, I encounter the following error message trying to execute COPY INTO command with 25,529 blobs in ADLS2 storage account. Same command using smaller number of files works as expected. Could you please elaborate on this matter?
Is there a limit and why command returns 403 status?
Best,
-Sergei
Additional info:
Client:
SSMS v18.9.1
Databricks runtime:
8.3.x-scala2.12
Server version:
Microsoft Azure SQL Data Warehouse - 10.0.13580.0 Jul 31 2021 18:43:30 Copyright (c) Microsoft Corporation
SQL Command:
COPY INTO schema.table
FROM dfs_location_folder_path
WITH (
FILE_TYPE = 'PARQUET',
CREDENTIAL = xxxxx
COMPRESSION = 'Snappy',
IDENTITY_INSERT = 'OFF'
)
Error message:
Not able to validate external location because The remote server returned an error: (403) Forbidden.

I recommend you contact Azure Synapse Analytics (Azure SQL Data Warehouse) support. This repo is for the Microsoft JDBC Driver for SQL Server. We do not know why the server would be returning that error message.
Regards,
David

Thank you David.
The reason I posted the question in this repo was because my application (ADB) is using JDBC Driver for SQL Server and initial error was produced by the com.databricks.spark.sqldw.SqlDWSideException class.
"Azure Synapse Analytics failed to execute the JDBC query produced by the connector". I will reach out to the other team as you suggested.
Best,
-Sergei


Prepare UE emulation projects comparison

eUPF has been already integrated with UERANSIM project. srsRAN project is under reasearch at the moment. In order to share our experience to community procs and cons, pitfalls and advantages of both RAN emulation projects have to be documanted.

[ ] Comparison table prepared and documented
[ ] Usage experience are breifly documented

You might want to check https://github.com/HewlettPackard/PacketRusher as well :-)


Monitor chain heights

We want to monitor that chain heights are increasing. This would be thorchain, binance, bitcoin, etc. So we'll need IP addresses for each chain. These chains may run on a  separate IP address.
For thorchain/binance, its the same...
curl -s localhost:26657/status | jq -r '.result.sync_info.latest_block_height'

Bitcoin and ethereum we can handle a different day when we're further in the development

Must admit that I'm not too familiar with the THORchain skeleton after a quick look at the white paper.
Until now, only stats of thorchain nodes are monitored through the /nodeaccounts endpoint.
To do that, the user adds one (or in future more) thornode address.
Do I understand correctly that the chain height monitoring would mean to monitor different nodes than the now monitored thornodes?
So this doesn't relate at all to the above added thornode address? Can this be seen as a completely new feature, different from the monitoring until now?
Is it also necessary to add addresses for binance, bitcoin etc. nodes?
Should hardcoded or random addresses be used?

Chain height monitoring is a sanity check that YOUR node is healthy, and pulling down new blocks. And you're not comparing against other nodes, just that your own node has increasing block heights (ie not stuck on height 345).
We'll want to do the same for each of the full nodes as well, which would be a different endpoint. This notifies the owner that one of their chains are broken, and will likely cause slash points


When saving doc/settings, inherited settings are also persisted

Came across this scenario:

A .netconfig.user file somewhere up in the directory hierarchy contains some settings
Used a tool that reads/saves settings (dotnet file in this case), and when it saved, it pulled those values from the inherited file and saved them to the current directory.
NOTE: it did save the values to a local .netconfig.user, so at least it didn't move the values from .user to shared file 😓

This should not happen. Entries should only be saved if they were read from the same file originally.

This was a user error, had an inherited config that actually pointed to a url to download with a .netconfig.user file as a target :)


A first atempt at lower and upper bound, there is for sure some logic…

…al problem in this. It's to late for this kind of work tbh.

Need to run git pull origin main


Added deleteAllAt() to remove list of indices

As suggested in this StackOverflow thread, I've added a function that allows multiple elements in a box to be deleted at the same time based off of a list of indices.
I've also written tests for the new function.

Any updates on merging this PR?

Sorry for this one taking so long, I am not sure about merging the change as it doesn't add any new feature to the library. There's already existing methods for converting indices to keys and method for deleting items in bulk with keys. This is by no means a final decision, just my personal opinion. Maybe other maintainers may have different opinions.

Understood. I think this just improves developer experience in some cases.


samples: tfm_integration: tfm_ipc: Remove regression dependency

Removes the dependency on the external test service from the
CONFIG_TFM_REGRESSION_S test suite, instead
demonstrating how to make direct IPC calls to the CRYPTO
service that is available as a part of standard TF-M builds.
This resolves an issue with the test service having been changed upstream.
Re-targeting the IPC functions to a native TF-M service, however, also
removes an unnecessary external dependency for this sample.
Depends on https://github.com/zephyrproject-rtos/zephyr/pull/35599
Signed-off-by: Kevin Townsend<EMAIL_ADDRESS>

I'll drag this into the TF-M update PR, see what happens.

This is included in the TFM manifest update branch, @microbuilder could this be closed?

This is included in the TFM manifest update branch, @microbuilder could this be closed?

Yes 👍


Integration test failures on browsers without h264 and aac

(Originally discussed in https://github.com/google/shaka-player/pull/2849)
Have you read the FAQ and checked for duplicate open issues?
yes
What version of Shaka Player are you using?
3.0.4
Can you reproduce the issue with our latest release version?
yes
Can you reproduce the issue with the latest code from master?
yes
Are you using the demo app or your own custom app?
n/a
If custom app, can you reproduce the issue using our demo app?
n/a
What browser and OS are you using?
LSB Version:    :core-4.1-amd64:core-4.1-noarch
Distributor ID:    Fedora
Description:    Fedora release 32 (Thirty Two)
Release:    32
Codename:    ThirtyTwo
Chromium 85.0.4183.102 Fedora Project
Mozilla Firefox 80.0.1
Python 3.8.5
What did you do?

run ./build/test.py
What did you expect to happen?
test will pass
What actually happened?
test fails with the following output:
[WARNING] Using default browsers: ['Chrome', 'Firefox']
[INFO] Generating Closure dependencies...
[INFO] Compiling the library (ui, release)...
[WARNING] No changes detected, skipping. Use --force to override.
[INFO] Running test (1 / 1, 0 failed so far)...
Chrome 85.0.4183.83 (Fedora 0.0.0) CastUtils serialize/deserialize TimeRanges deserialize into equivalent objects FAILED
    Error: Failed: Type negotiation should happen before MediaSourceEngine.init!
        at <Jasmine>
        at Function.jasmineAssert (test/test/boot.js:38:7 <- test/test/boot.js:41:7)
        at _loop (lib/media/media_source_engine.js:296:20 <- lib/media/media_source_engine.js:7145:32)
        at _class._callee2$ (lib/media/media_source_engine.js:294:53 <- lib/media/media_source_engine.js:7197:19)
        at tryCatch (node_modules/babel-polyfill/dist/polyfill.js:6900:40)
    NotSupportedError: Failed to execute 'addSourceBuffer' on 'MediaSource': The type provided ('video/mp4; codecs="avc1.42c01e"') is unsupported.
    error properties: Object({ INDEX_SIZE_ERR: 1, DOMSTRING_SIZE_ERR: 2, HIERARCHY_REQUEST_ERR: 3, WRONG_DOCUMENT_ERR: 4, INVALID_CHARACTER_ERR: 5, NO_DATA_ALLOWED_ERR: 6, NO_MODIFICATION_ALLOWED_ERR: 7, NOT_FOUND_ERR: 8, NOT_SUPPORTED_ERR: 9, INUSE_ATTRIBUTE_ERR: 10, INVALID_STATE_ERR: 11, SYNTAX_ERR: 12, INVALID_MODIFICATION_ERR: 13, NAMESPACE_ERR: 14, INVALID_ACCESS_ERR: 15, VALIDATION_ERR: 16, TYPE_MISMATCH_ERR: 17, SECURITY_ERR: 18, NETWORK_ERR: 19, ABORT_ERR: 20, URL_MISMATCH_ERR: 21, QUOTA_EXCEEDED_ERR: 22, TIMEOUT_ERR: 23, INVALID_NODE_TYPE_ERR: 24, DATA_CLONE_ERR: 25, code: 9 })
    Error: Failed to execute 'addSourceBuffer' on 'MediaSource': The type provided ('video/mp4; codecs="avc1.42c01e"') is unsupported.
        at _loop (lib/media/media_source_engine.js:311:48 <- lib/media/media_source_engine.js:7168:85)
        at _class._callee2$ (lib/media/media_source_engine.js:294:53 <- lib/media/media_source_engine.js:7197:19)
        at tryCatch (node_modules/babel-polyfill/dist/polyfill.js:6900:40)
        at Generator.invoke [as _invoke] (node_modules/babel-polyfill/dist/polyfill.js:7138:22)
        at Generator.prototype.<computed> [as next] (node_modules/babel-polyfill/dist/polyfill.js:6952:21)
        at step (lib/media/media_source_engine.js:6705:191)
        at lib/media/media_source_engine.js:6705:361
    Error: Expected 0 to be greater than 0.
        at <Jasmine>
        at UserContext.<anonymous> (test/cast/cast_utils_unit.js:251:33 <- test/cast/cast_utils_unit.js:363:33)
        at <Jasmine>
Chrome 85.0.4183.83 (Fedora 0.0.0) UI controls overflow menu allows picture-in-picture only when the content has video FAILED
        Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()
Chrome 85.0.4183.83 (Fedora 0.0.0) UI controls resolutions menu clears the buffer when changing resolutions FAILED
        Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()
Chrome 85.0.4183.83 (Fedora 0.0.0) UI controls resolutions menu displays resolutions based on current stream FAILED
        Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()
Chrome 85.0.4183.83 (Fedora 0.0.0) CastReceiver sends update messages every stage of loading FAILED
        [object Object] thrown
Chrome 85.0.4183.83 (Fedora 0.0.0) ERROR
  An error was thrown in afterAll
  Failed: Unhandled rejection in Promise: shaka.util.Error {
    "severity": 2,
    "category": 4,
    "code": 4032,
    "data": [],
    "handled": false,
    "message": "Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()"
  }
  Error: Failed: Unhandled rejection in Promise: shaka.util.Error {
    "severity": 2,
    "category": 4,
    "code": 4032,
    "data": [],
    "handled": false,
    "message": "Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()"
  }
      at <Jasmine>
      at test/test/boot.js:56:5 <- test/test/boot.js:59:5
Chrome 85.0.4183.83 (Fedora 0.0.0) ERROR
  Disconnected, because no message in 300000 ms.
Chrome 85.0.4183.83 (Fedora 0.0.0) CastUtils serialize/deserialize TimeRanges deserialize into equivalent objects FAILED
        Error: Failed: Type negotiation should happen before MediaSourceEngine.init!
            at <Jasmine>
        at Function.jasmineAssert (test/test/boot.js:38:7 <- test/test/boot.js:41:7)
        at _loop (lib/media/media_source_engine.js:296:20 <- lib/media/media_source_engine.js:7145:32)
        at _class._callee2$ (lib/media/media_source_engine.js:294:53 <- lib/media/media_source_engine.js:7197:19)
        at tryCatch (node_modules/babel-polyfill/dist/polyfill.js:6900:40)
    NotSupportedError: Failed to execute 'addSourceBuffer' on 'MediaSource': The type provided ('video/mp4; codecs="avc1.42c01e"') is unsupported.
    error properties: Object({ INDEX_SIZE_ERR: 1, DOMSTRING_SIZE_ERR: 2, HIERARCHY_REQUEST_ERR: 3, WRONG_DOCUMENT_ERR: 4, INVALID_CHARACTER_ERR: 5, NO_DATA_ALLOWED_ERR: 6, NO_MODIFICATION_ALLOWED_ERR: 7, NOT_FOUND_ERR: 8, NOT_SUPPORTED_ERR: 9, INUSE_ATTRIBUTE_ERR: 10, INVALID_STATE_ERR: 11, SYNTAX_ERR: 12, INVALID_MODIFICATION_ERR: 13, NAMESPACE_ERR: 14, INVALID_ACCESS_ERR: 15, VALIDATION_ERR: 16, TYPE_MISMATCH_ERR: 17, SECURITY_ERR: 18, NETWORK_ERR: 19, ABORT_ERR: 20, URL_MISMATCH_ERR: 21, QUOTA_EXCEEDED_ERR: 22, TIMEOUT_ERR: 23, INVALID_NODE_TYPE_ERR: 24, DATA_CLONE_ERR: 25, code: 9 })
    Error: Failed to execute 'addSourceBuffer' on 'MediaSource': The type provided ('video/mp4; codecs="avc1.42c01e"') is unsupported.
        at _loop (lib/media/media_source_engine.js:311:48 <- lib/media/media_source_engine.js:7168:85)
        at _class._callee2$ (lib/media/media_source_engine.js:294:53 <- lib/media/media_source_engine.js:7197:19)
        at tryCatch (node_modules/babel-polyfill/dist/polyfill.js:6900:40)
        at Generator.invoke [as _invoke] (node_modules/babel-polyfill/dist/polyfill.js:7138:22)
        at Generator.prototype.<computed> [as next] (node_modules/babel-polyfill/dist/polyfill.js:6952:21)
        at step (lib/media/media_source_engine.js:6705:191)
        at lib/media/media_source_engine.js:6705:361
    Error: Expected 0 to be greater than 0.
        at <Jasmine>
        at UserContext.<anonymous> (test/cast/cast_utils_unit.js:251:33 <- test/cast/cast_utils_unit.js:363:33)
        at <Jasmine>
Chrome 85.0.4183.83 (Fedora 0.0.0) UI controls overflow menu allows picture-in-picture only when the content has video FAILED
        Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()
Chrome 85.0.4183.83 (Fedora 0.0.0) UI controls resolutions menu clears the buffer when changing resolutions FAILED
        Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()
Chrome 85.0.4183.83 (Fedora 0.0.0) UI controls resolutions menu displays resolutions based on current stream FAILED
        Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()
Chrome 85.0.4183.83 (Fedora 0.0.0) CastReceiver sends update messages every stage of loading FAILED
        [object Object] thrown
Chrome 85.0.4183.83 (Fedora 0.0.0) ERROR
  An error was thrown in afterAll
  Failed: Unhandled rejection in Promise: shaka.util.Error {
    "severity": 2,
    "category": 4,
    "code": 4032,
    "data": [],
    "handled": false,
    "message": "Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()"
  }
  Error: Failed: Unhandled rejection in Promise: shaka.util.Error {
    "severity": 2,
    "category": 4,
    "code": 4032,
    "data": [],
    "handled": false,
    "message": "Shaka Error MANIFEST.CONTENT_UNSUPPORTED_BY_BROWSER ()"
  }
      at <Jasmine>
      at test/test/boot.js:56:5 <- test/test/boot.js:59:5
Chrome 85.0.4183.83 (Fedora 0.0.0): Executed 1744 of 1988 (5 FAILED) (skipped 30) ERROR (24.181 secs / 21.252 secs)
Firefox 80.0 (Fedora 0.0.0): Executed 1905 of 1988 (skipped 83) SUCCESS (6 mins 3.424 secs / 5 mins 58.52 secs)
Chrome 85.0.4183.83 (Fedora 0.0.0): Executed 1744 of 1988 (5 FAILED) (skipped 30) ERROR (24.181 secs / 21.252 secs)
[INFO] Run complete
[INFO] Result (exit code): 1

Can you please visit this page in that same copy of Chrome, and copy the output here?  https://shaka-player-demo.appspot.com/support.html
That will give us an idea of what codecs and formats are supported by the browser.  We may have made some bad assumptions somewhere.

Not sure if it does matter, but it's Chromium (version from the oficial Fedora repository), not Chrome.
  No proprietary codecs such as h264 or aac are supported.  Conversely, we support browsers that don't have vp9 or opus, where h264 and aac are the only options.
So anywhere we have integration test cases that use h264 or aac content, we need to have an alternative source in vp9 or opus.
Thanks!

Hey guys, I've come across a similar problem verifying assets playing on the project I work for. In fact, I'm automating the regression tests using cypress and when I come to a step for verifying the video asset is playing, I got an exception with the same codes.
"category": 6,
"code:" 6001,
and
"category": 4,
"code": 4032,
Tried on all chromium based browsers and firefox :(

I think the problem should be "will not implement" because with github actions you can test PR, also this combination is not the most used. @joeyparrish , what do you think?

You might be right.  In theory, I think I would accept a PR to skip tests that depend on AAC or H264 when they are missing.  But since we have no such devices of our own, I think new test cases would get added that would break it again.
If someone wants to do the work to add alternative content with VP9 and Opus for all test cases, I think I would accept that, too.  But the same issue applies, I think.  If we don't exercise that path ourselves, we will eventually regress.
So none of these solutions is sustainable without an easy way to disable H264/AAC in a node of our Selenium grid.
I'll leave it open for a few days to see if anyone is interested in doing this work.  If not, the robot will close the issue.
Thanks!


Add section on using github project view

create GitHub Issues and a Project to keep a backlog, prioritize and track progress. Here is a example project using project/issues.


Changing the SID causes a error on startup

Add new ORACLE_SID environment to the Dockerfile
ENV ORACLE_SID=NEWSID

If I start this container
Attaching to db-1
db-1  | CONTAINER: starting up...
db-1  | CONTAINER: first database startup, initializing...
db-1  | mv: cannot stat '/opt/oracle/product/23c/dbhomeFree/dbs/spfileNEWSID.ora': No such file or directory

Hi @drmaniac,
Thanks a lot for your interest in these images.
The ORACLE_SID is not configurable for Oracle Database Free and hence also not for these images.

Hi @gvenzl ,
Thanks for the clarification


"bolt" image storage type isn't supported

Readme and source code mention bolt image storage type. But looks like it isn't supported atm (https://github.com/umputun/remark/blob/master/backend/app/cmd/server.go#L485).

yeah, looks like I never implemented this storage for images. Should be easy to do, I'll mark it as "good-first-issue" and hopefully, someone will help with this.

Would like to give it a try

First time trying to contribute to open source, any remarks and suggestions are very much appreciated

I'll try to implement.  I'll notify if I give up in few days.

oops, didn't see that ^ PR and just submitted mine https://github.com/umputun/remark/pull/450


feat(executor): Stateful operators should stream newly arriving messages

With https://github.com/singularity-data/risingwave/issues/2428 we observe the issue that there is a need to fetch entries per update, but sometimes (actually, quite frequently for tpch), updates come in batches of 1 or 2. Thus, we cannot exploit concurrency because the system is still written in a batch update fashion.
Hence, we should properly exploit concurrent streaming by allowing new messages to be added to a queue instantly, multiplexed into sync_queue and async_queue, sync_queue is a dequeue of work that can be performed instantly, async queue is an unbounded queue of work that completes async. Hopefully, we can reduce the overall latency this way.
Notes:

This pattern is probably best applied to all stateful operators with async fetch and local cache (e.g. hash agg)

updates come in batches of 1 or 2.

How does it happen? Which executor produces the small chunk?

updates come in batches of 1 or 2.

Same question. Can this be solved by turning the checkpoint interval larger?

I guess the point is that executors should not wait for an input chunk to be fully processed before processing the next input chunk.
To generalize a bit, we should do things as if vectorization provides 0 benefits. But since vectorization actually makes things faster, we should have a tradeoff/balance here.

To generalize a bit, we should do things as if vectorization provides 0 benefits. But since vectorization actually makes things faster, we should have a tradeoff/balance here.

Vectorization can be preserved in sync_queue here. For async_queue there might be a tradeoff.

But since vectorization actually makes things faster, we should have a tradeoff/balance here.

I believe the relevant issue is https://github.com/singularity-data/risingwave/issues/2755 for getting the benefits of vectorization. I believe that improving the chunk size consistency is an orthogonal improvement.
The tradeoff is latency v.s. throughput. So the solution I thought best was to wait for a fixed timeout (proposed to be 1ms) since last message before forwarding accumulated chunks. Every operator that does accumulation should follow this behaviour.

How does it happen? Which executor produces the small chunk?

I believe it was tpch q14 and q3

Vectorization can be preserved in sync_queue here. For async_queue there might be a tradeoff.

I don't think vectorization makes that much of a difference for stateful operators, which must spend time doing random lookup at best and at worst, async I/O. Correct me if I'm wrong. Probably vectorization is only useful for simple agg/simple arithmetic expressions (e.g. projection expression)?

Same question. Can this be solved by turning the checkpoint interval larger?

How to do this?

Same question. Can this be solved by turning the checkpoint interval larger?

How to do this?

In risingwave.toml we have a checkpoint interval config. Simply update it and start risedev cluster.

I had the checkpoint interval set to 100ms.
What I found was that it was the updates which would result in cache hit that were very few in number. I guess it was usually one side of the updates (the right side prior to ) that was producing very few rows/s.
Should be investigated further... (with metrics)

Also might cause a problem producing duplicate pks... can be resolved if we make join key part of pk?
pk:       1st col
Join key: 2nd col

I 1 2 unmatched
D 1 2 unmatched
I 1 3 matched
D 1 3 matched

After reorder due to async fetching

I 1 3 matched
I 1 2 unmatched
D 1 2 unmatched
D 1 3 matched

This produce 2 identical insert PK to the downstream

I guess the point is that executors should not wait for an input chunk to be fully processed before processing the next input chunk, if CPU is idle.

Yes, I agree this is his point. But I think this proposal would not improve the latency directly, because latency is determined by barrier, and barrier cannot pass until all pending messages in async_queue to be processed.
Instead, this might improve the throughput by batching all "cache-missed" data together to emit requests to S3.

Actually some of the discussion from my end might be wrong, there is indeed vectorization for hash tables (vertical vectorization). It's basically fine to apply it in our case as we always need to first probe the hashmap cache prior to multiplexing into sync/async.

In another words, the quick messages do not help to improve the latency of barriers.

Actually, I disagree here.
Consider the following:
arrival time: 0ms message(10 sync, 10 async) async I/O: latency 5ms
arrival time: 1ms message(10 sync, 10 async) async I/O: latency 5ms
Total time for main: 5 * 10 * 2 = 100ms
Total time for concurrent fetch (https://github.com/singularity-data/risingwave/issues/2428): 5 + 5 = 10ms
Total time for this streaming messages (this issue): 5 + 1 = 6ms
Basically, even with concurrent fetch, if your message frequency < async I/O latency, you will expand out that latency to the async I/O latency. Rather than combatting with more parallelism (more shards), you could just process more messages' async I/O concurrently by adopting the streaming approach.
I also tend to think that the faster we allow the downstream operators to do useful work, the better utilization and latency we can get from our system.

Also might cause a problem producing duplicate pks... can be resolved if we make join key part of pk?

From our discussion offline @yuhao-su and I concluded this will cause unnecessary columns to be present in downstream output of joins, especially bad for many-way joins.
We discussed and I think I have a solution, I will write an RFC/design doc. Basically, its just having PK-dependent updates wait in special queues until their prior update is completed.

In another words, the quick messages do not help to improve the latency of barriers.

Actually, I disagree here.
Consider the following:
arrival time: 0ms message(10 sync, 10 async) async I/O: latency 5ms
arrival time: 1ms message(10 sync, 10 async) async I/O: latency 5ms
Total time for main: 5 * 10 * 2 = 100ms
Total time for concurrent fetch (https://github.com/singularity-data/risingwave/issues/2428): 5 + 5 = 10ms
Total time for this streaming messages (this issue): 5 + 1 = 6ms
Basically, even with concurrent fetch, if your message frequency < async I/O latency (due to high streaming throughput), you will expand out that latency to the async I/O latency. Rather than combatting with more parallelism (more shards), you could just process more messages' async I/O concurrently by adopting the streaming approach.
I also tend to think that the faster we allow the downstream operators to do useful work, the better utilization and latency we can get from our system. For instance, downstream async I/O could begin earlier as a result.
Probably there is some math to show this by modelling as fluid flows...

OK, I misunderstood it before. This approach seems an enhanced version of concurrent fetch to me.
Furthermore, I think it's possible to preserve the message order in this case. Similar to the TCP protocol, a later packet/fetch may be received first, but we can just put it in the queue until all its prior packet done

a later packet/fetch may be received first, but we can just put it in the queue until all its prior packet done

Yes, but actually, all we need to preserve is message ordering for a given PK. Would you agree?

a later packet/fetch may be received first, but we can just put it in the queue until all its prior packet done

Yes, but actually, all we need to preserve is update ordering for a given PK. Would you agree?

In another word, only insert messages (without any delete/update event between them) are reorderable?

In another word, only insert messages (without any delete/update event between them) are reorderable?

Actually, no, invidivual insert, delete, update can be reordered as long as the order of the row + op is preserved for a given PK.

In another word, only insert messages (without any delete/update event between them) are reorderable?

Actually, no, invidivual insert, delete, update can be reordered as long as the order of the row + op is preserved for a given PK. That is unless PK can change for a given row...

Yes, but this algorithm need to maintain a set of PK in this epoch, which seems a little complex to me.
In practice, I prefer the simplest solution - just preserve the order of all rows, no matter what they are. Will this harm the performance?

well, it would if majority of the rows hit cache, but a small number result in async I/O. Then there would be a large fraction of rows waiting for rows ahead of them.
I agree however that that's a simpler solution.

That is unless PK can change for a given row...

Actually, is this even possible? Seems like no right? An update only occurs if a row identified by PK changes.

Yes, but this algorithm need to maintain a set of PK in this epoch, which seems a little complex to me.

Its slightly complex, but maybe I will write up a solution and we can judge if its worth it to test out. My sense is that its not significantly complex.

Yes, but this algorithm need to maintain a set of PK in this epoch, which seems a little complex to me.

Its slightly complex, but maybe I will write up a solution and we can judge if its worth it to test out. My sense is that its not significantly complex.

Is it possible to implement it in a way that we still can disallow the reordering of rows but only do concurrent state fetching for consecutive data chunks?
I think it would be very helpful for us to understand what each technique can bring to us 🤔

Is it possible to implement it in a way that we still can disallow the reordering of rows but only do concurrent state fetching for consecutive data chunks?

Yes. But as discussed:

well, it would if majority of the rows hit cache, but a small number result in async I/O. Then there would be a large fraction of rows waiting for rows ahead of them.

Basically, if you expect ocassional cache miss but high cache hit, downstream can process new rows much more quickly.

Also, here is the pseudocode for hashjoin (its not that complex! just an additional small hashmap for pending PK entries):
fn process_chunk(&mut self, chunk: StreamChunk) {
    for row in chunk {
      // delay the processing until pk dependency completes
      if let Some(mut in_progress_rows) = self.pk_in_progress.get_mut(row.pk) {
        // clone it so we can throw away this chunk
        in_progress_rows.push(pk.row.to_owned_row());
      } else {
        // We are ok to process the row in any order because there is no outstanding
        // task for that PK.
        self.process_rows_out_of_order(row)
    }
}

fn process_rows_out_of_order(&mut self, row: &RowRef) {
  if let Some(entries) = self.cache.get_both_sides(row.join_key) {
    // if no dependencies and available in cache, process instantly
    self.process(row, entries);
  } else {
    // else, not available locally, add to async queue
    let entry = self.async_queue.entry(row.join_key).or_insert_with(Vec::new);
    if entry.is_empty() {
        // trigger the fetch of the join key data
        self.task_stream.push(async move {
            let jk_entries = self.cache.fetch_both_sides(row.join_key).await;

            // once we fetch the JK entry via async I/O, we can process it
            // and queue any dependent entries.
            for row in self.async_queue.get(row.join_key) {
                self.process(row, entries);
                let pk_entry = self.pk_in_progress.get_mut(row.pk).unwrap();
                // remove this row from pending
                pk_entry.pop_head();
                // process the next row for this PK
                if !pk_entry.is_empty() {
                    self.process_row_out_of_order(pk_entry[0]);
                }
            }
        });
    }
    // mark this row as pending for its PK.
    entry.push(pk.row.to_owned_row());
  }
}

Note that flink also has a knob allowing trading off latency for throughput in terms of the buffering timeout:

https://www.ververica.com/blog/high-throughput-low-latency-and-exactly-once-stream-processing-with-apache-flink