TestMessageClientBasicMultiTopics is unstable

Which jobs are flaking?
TestMessageClientBasicMultiTopics
Which test(s) are flaking?
leak_test
Jenkins logs or GitHub Actions link
--- FAIL: TestMessageClientBasicMultiTopics (49.96s)
[2022-04-19T08:32:29.707Z]     server_client_integration_test.go:155:
[2022-04-19T08:32:29.707Z]         	Error Trace:	server_client_integration_test.go:155
[2022-04-19T08:32:29.707Z]         	            				asm_amd64.s:1571
[2022-04-19T08:32:29.707Z]         	Error:      	Received unexpected error:
[2022-04-19T08:32:29.707Z]         	            	context deadline exceeded
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/errors.AddStack
[2022-04-19T08:32:29.707Z]         	            		/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/errors.go:174
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/errors.Trace
[2022-04-19T08:32:29.707Z]         	            		/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/juju_adaptor.go:15
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/tiflow/pkg/p2p/internal.(*SendChan).SendSync
[2022-04-19T08:32:29.707Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/internal/send_chan.go:77
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/tiflow/pkg/p2p.(*MessageClient).sendMessage
[2022-04-19T08:32:29.707Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/client.go:441
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/tiflow/pkg/p2p.(*MessageClient).SendMessage
[2022-04-19T08:32:29.707Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/client.go:385
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/tiflow/pkg/p2p.runP2PIntegrationTest.func6
[2022-04-19T08:32:29.707Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/server_client_integration_test.go:154
[2022-04-19T08:32:29.707Z]         	            	runtime.goexit
[2022-04-19T08:32:29.707Z]         	            		/usr/local/go/src/runtime/asm_amd64.s:1571
[2022-04-19T08:32:29.707Z]         	Test:       	TestMessageClientBasicMultiTopics
[2022-04-19T08:32:29.707Z]     server_client_integration_test.go:155:
[2022-04-19T08:32:29.707Z]         	Error Trace:	server_client_integration_test.go:155
[2022-04-19T08:32:29.707Z]         	            				asm_amd64.s:1571
[2022-04-19T08:32:29.707Z]         	Error:      	Received unexpected error:
[2022-04-19T08:32:29.707Z]         	            	context deadline exceeded
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/errors.AddStack
[2022-04-19T08:32:29.707Z]         	            		/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/errors.go:174
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/errors.Trace
[2022-04-19T08:32:29.707Z]         	            		/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20211224045212-9687c2b0f87c/juju_adaptor.go:15
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/tiflow/pkg/p2p/internal.(*SendChan).SendSync
[2022-04-19T08:32:29.707Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/internal/send_chan.go:77
[2022-04-19T08:32:29.707Z]         	            	github.com/pingcap/tiflow/pkg/p2p.(*MessageClient).sendMessage
[2022-04-19T08:32:29.707Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/client.go:441
[2022-04-19T08:32:29.708Z]         	            	github.com/pingcap/tiflow/pkg/p2p.(*MessageClient).SendMessage
[2022-04-19T08:32:29.708Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/client.go:385
[2022-04-19T08:32:29.708Z]         	            	github.com/pingcap/tiflow/pkg/p2p.runP2PIntegrationTest.func6
[2022-04-19T08:32:29.708Z]         	            		/home/jenkins/agent/workspace/cdc_ghpr_leak_test/go/src/github.com/pingcap/tiflow/pkg/p2p/server_client_integration_test.go:154

https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_leak_test/detail/cdc_ghpr_leak_test/24341/pipeline
https://ci.pingcap.net/blue/organizations/jenkins/ut-check/detail/ut-check/9241/pipeline/
Anything else we need to know

Does this test exist for other branches as well?

Has there been a high frequency of failure lately?

another case: https://ci.pingcap.net/blue/organizations/jenkins/ut-check/detail/ut-check/9220/pipeline

another case: https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_leak_test/detail/cdc_ghpr_leak_test/24449/pipeline

another case: https://ci.pingcap.net/blue/organizations/jenkins/ut-check/detail/ut-check/9310/pipeline

Seems the same case:
https://ci.pingcap.net/blue/organizations/jenkins/ut-check/detail/ut-check/9387/pipeline/


fix crash caused by memory misalignment in function fill_usb_buffer

I rollback the local master branch and updated latest source code from upstream's master branch, then created a new work branch "fill_usb_buffer_1 " for this pr. so It seems clean now.

CI failed with the log snippet as following:
Streaming modes sanity check
check stream profile settings are sane
/home/travis/build/IntelRealSense/librealsense/unit-tests/unit-tests-live.cpp:1250
...............................................................................
/home/travis/build/IntelRealSense/librealsense/unit-tests/unit-tests-live.cpp:1293: FAILED:
REQUIRE_NOTHROW( dev.open({ profile }) )
due to unexpected exception with message:
Recording history mismatch! call type: 19 entity 0

The PR will be auto-completed once dev is merged with master after release


Support std::char::UNICODE_VERSION

Values of that constant depend on Rust version:
Rust 1.44: (13, 0, 0)
Rust 1.38 to 1.43: (12, 1, 0)
Rust 1.28 to 1.37: (11, 0, 0)

Can you please provide a source? This seems like a trivial addition that I could make this weekend.

For Rust 1.44, upgrade to Unicode 13.0 was mentioned in changelog: https://github.com/rust-lang/rust/blob/master/RELEASES.md.
For determination whether Unicode version is at least 12, the following program can be executed. U+10FE0 character was added in Unicode 12.0. https://github.com/rust-lang/rust/pull/62641 did update Unicode version from 11.0 to 12.1 (see diff for src/libcore/unicode/tables.rs), so there is no need to concern about 12.0, no version of Rust had 12.0, the update was to 12.1.
fn main() {
    println!("{}", '\u{10FE0}'.is_alphabetic());
}

For determination whether Unicode version is at least 11, the following program can be executed. U+1C90 character was in Unicode 11.0. The minimum Rust version supported by standback is 1.31, and the Unicode update occured in 1.28, so there is no need to look deeper.
fn main() {
    println!("{}", '\u{1C90}'.is_alphabetic());
}

For list of Unicode versions, https://unicode.org/history/publicationdates.html can be checked. 11.0.0, 12.0.0, 12.1.0 and 13.0.0 were the only Unicode versions that need to be tested.

Status update: I'm quite busy, and intend on doing a joint release for 1.45 and 1.46 support. This would include both this issue and the open PR.


Need some basic tutorial for OBJ+MTL Export

Heya!
I'll ask this in English just to be sure but first things first, I came across this tool by a dev of "qpang.net", then secondly, some explanation as to why I need the assets. I am working on portfolio projects for school where I want to recreate the original QPang assets and make them far more detailed and basically turn them into some Mark 2 version.
An example: https://www.artstation.com/artwork/ao045k
Hopefully you can help me out here because a 3D reference for me to work from rather than a 80px wide blurry image would help a lot.
Thanks!

For what you want to do, the tool unfortunately only really supports map data; I never got around to finishing and publishing the .ONA tools for editing character & weapon data.
That said, you can export maps to .obj + .mtl by using the Scene Exporter.

Import the map file you want to export (e.g. q08_bunker.pack) using the File menu.
Navigate to the main .mesh file (e.g. q08_bunker.pack/mesh/q08_bunker.mesh) and open it.
In the Content area, right click an empty spot and choose Export Scene in the action menu that pops up.
The settings should be autofilled correctly -- simply press the Export Scene button in the dialog and choose a file location to export it to.
If all went well, you should be able to find the .obj, .mtl and texture files at the output location. Objects are already separated by group, so software such as Blender won't treat the exported map as a singular object.

If you're looking for character & weapon models specifically, you could try asking around the community (if they're still around) to see if anyone still has them. I'd love to finish writing the tools for it, but right now I have other priorities.

I will try it out when I have the chance. I completely understand you have other things to do but if you ever have some spare time, it'd be amazing if you can work on weapon/character assets.
That being said, thanks and I'll try it out soon!


Browser hangs up when escaped brackets are echoed

Expected behavior
I expect to be able to output any text to the terminal. I understand that I might need to escape some special characters used for formatting, e.g. square brackets (is any helper method available?). In case I escape them, everything should work fine.
Actual behavior
When I echo a text containing escaped brackets (e.g. 'a\\[i\\]=42'), browser hangs up. Note that I have to escape them at least inside color formatting syntax ([[b;white;red]text]).
Steps to reproduce
See this code pen: https://codepen.io/paulsmirnov/pen/ZPYavo
Uncomment the tagged line to experience the issue.
P.S. Note that you don't need to use formatting syntax to hang up, simple echo is enough: term.echo(msg);. I've just decided to show you a motivation behind escaping.
Browser and OS

Windows 10
Google Chrome 72.0.3626.119 (Official Build) (64-bit)

Thanks for the report. This is very bad event this don't work:
term.echo('Display [[b;white;red]' + $.terminal.escape_brackets('a[i]=42') + '] and hang up!');

It don't hang locally when I tested but the output is totally broken also nested formatting give weird output and make this event worse.

The problem was that unix formatter (from_ansi) was meta formatter (it had __meta__ == true marker) so it processed whole command not only between formatting like normal formatter.
This is changing how unix formatting works but I think it's fine. I don't think that it will break someones code and if it do he can add back __meta__ marker.


JSON.Mapping and optional NamedTuples

Hi all,
For Crystal 0.25.1, I have a case where I have a Mapping as follows:
JSON.mapping(
  items: Array({
    "id": Int64,
    "active": Bool,
    ...
  })
)

I use rest call to bring in JSON data from a URL.  The "active" is optional in some cases.  I tried adding Bool? to see if that will help.  However, the from_json.cr code is ending up throwing an exception.
Work around I had was to have a | for each of the optional named tuple fields:
 JSON.mapping(
  items: Array({
    "id": Int64,
    "active": Bool,
    ...
  } | {
    "id": Int64,
     ...   # Without the "active" NamedTuple
  })
)

Now this can lead to some rather unpleasant and hard-to maintain code depending on number of optional fields.  What would be the right way to handle or declare these?  One thought is to perhaps have "Bool?" as a type to indicate that the exception noted above doesn't get thrown.  Thoughts?

Mapping options allows you to declare a field as nilable or define a default value. See API docs for specifications.

Sorry, forgot to mention that I tried that:
"active":  { type: Bool, nilable: true },
Received the following compiler error:
Syntax error in src/response/category_response.cr:13: expecting token 'CONST', not 'true'
  "is_active": { type: Bool, nilable: true },

Tried Bool? too, still errors out if missing value.  For what its worth, I think its something to do with the fact that the mapping is inside the Array({ NamedTuple }).  Here's a simple test code to show what I mean:
require "json"

# This class shows the case I'm trying to solve - Array of NamedTuples...
class Test
  JSON.mapping(
    items: Array({
      "active": Bool
      ## Here, "active": Bool? does not work,
      ## "active": { type: Bool, nilable: true } doesn't work
      ## tried a few other [non-sensicle?] things like type set to Bool | Nil.  No luck.
    })
  );
end

# This class works with nilable: true or Bool?  since its straight up NamedTuple
class Test2
  JSON.mapping(
    "active": { type: Bool, nilable: true }
  );
end

# Sample outputs (both output true) but note how the fact that structures are different.
puts Test.from_json(%({"items":[{"active": true}]})).items[0][:active]
puts Test2.from_json(%({"active": true})).active

This doesn't work. JSON.mapping expects a list of field names and types/options. Mappings can't be nested. You either need an additional type or a converter for your array.
@Sija You're right, Bool? should already work if properly used.

You need an Item type with its own mapping and then declare items: Array(Item) in you main type.
Note: this is a question for stackoverflow, not a language issue.

Understood @ysbaddaden .  I was debating whether this was an issue or not else would have asked directly on Stackoverflow.  Will start there going forward.  Thanks @straight-shoota @Sija.

@whizdom It's not an issue, @ysbaddaden answer is the correct one (use an Item type). Also, please start using JSON::Serializable instead of JSON.mapping. The latter will be eventually removed from the language.


How to download a ms-building id stac?

Hi,
first of all thank you for this project.
As I have writter here, I would like to download a ms-building id stack.
And I have tried to do it running:
stac-client search https://planetarycomputer.microsoft.com/api/stac/v1 -c ms-buildings --bbox 46.40 24.52 47.110 25.165 --max-items 1 | stac-asset download

But I have this error:
stac_asset.errors.DownloadError: error when downloading asset 'data' with href 'abfs://footprints/delta/2023-04-25/ml-buildings.parquet/RegionName=KingdomofSaudiArabia/quadkey=123022211': cannot read a file with the filesystem client if it has a url scheme: abfs://footprints/delta/2023-04-25/ml-buildings.parquet/RegionName=KingdomofSaudiArabia/quadkey=123022211

Is there a way to download it?

It looks like the abfs:// scheme is not supported yet. As shown here, the PlanetaryComputerClient is a subclass of HttpClient and can therefore only download assets with http-based HREFs.

Yup, thanks for the report. There's (at least) two things going on here:

[ ] We should error when we encounter unexpected protocols, instead of naïvely using HttpClient
[ ] We should add support for abfs protocols, following some of the document hints from https://planetarycomputer.microsoft.com/docs/quickstarts/stac-geoparquet/ (e.g. table:storage_options)


Disabled code coverage for xCode 9

plz check this issue
https://github.com/Carthage/Carthage/issues/2056

I found that code coverage is only exist on Test scheme. But not that framework scheme like SDWebImage iOS. Is that also affected by Xcode 9 's change?
Test.scheme
   <TestAction
      buildConfiguration = "Debug"
      selectedDebuggerIdentifier = "Xcode.DebuggerFoundation.Debugger.LLDB"
      selectedLauncherIdentifier = "Xcode.DebuggerFoundation.Launcher.LLDB"
      shouldUseLaunchSchemeArgsEnv = "YES"
      codeCoverageEnabled = "YES">
</TestAction>


Failed deletes (and loads) throw an exception

If a batch job has numberRecordsFailed then _wait_for_job will throw an exception. (this part is controversial)
Unless it is caught, the task that called it will throw an exception.
This means that the keywords Run Task and Run Task Class will also error.
All of this is tested below.
As far as we know, only DeleteData and LoadData uses these functions, but we don't know for sure about customers in the market.
It is unclear whether LoadData behaviour changes significantly, because it already has some error checking and exception raising.
====
This MAY NOT be an entirely backwards compatible change. Who knows how many errors are currently being swallowed in DeleteData (and perhaps also LoadData)? It is possible that some flows which currently seem to succeed will be revealed to actually have failing subtasks.
Arguably, we might need "exception behaviour" as a task option on effected tasks to give a way to get the old behaviour back.
Or arguably the old behaviour might be the default (during a transition period?)

I guess the questions that are open in my mind are:
a) do we have to consider the impact on any classes other than ones in CCI itself?
b) do we want DeleteData to be permissive by default (backwards compatible) or crashing-by-default?
c) do we want any changes to the behaviour of LoadData at all?

@prescod

a) do we have to consider the impact on any classes other than ones in CCI itself?

I think it's unlikely that it'll matter (and we can mention the potential impact in release notes). Searching github, the only use of BulkJobTaskMixin outside of CumulusCI is in this task that @davidmreed worked on at the sprint, and it doesn't look like it'll be affected. https://github.com/SFDO-Community-Sprints/DataGenerationTool/blob/master/tasks/GenerateRecordPermutations.py

b) do we want DeleteData to be permissive by default (backwards compatible) or crashing-by-default?

Reporting failures sounds better to me even if it's not backwards compatible. If you're using DeleteData you probably are aiming for the data to be gone and would want to know if it isn't.

c) do we want any changes to the behaviour of LoadData at all?

I don't think so, since it already provides a way to control whether row-level failures should abort or not, via the ignore_row_errors option.


Set websocket worker's loglevel for development based on ::Settings

This way we will inherit the loglevel configuration for WebsocketWorker when started with rails s

@miq-bot add_label developer


lxc image ls remote: does not respect proxy setting

Required information

Distribution: Ubuntu 20.04.4 LTS
Distribution version: 20.04
The output of "lxc info" or if that fails:

Kernel version: 5.4.0-144-generic
LXC version: 5.11
LXD version: 5.11
Storage backend in use: dir

Issue description
Although lxd is configured to use a proxy, when running lxc image ls ubuntu: the proxy server is not respected. Since this proxy is our only way to connect to the internet, I cannot list the images available on any image server on the internet.
tc@lab-dev-vm-host:~$ lxc config show
config:
  core.https_address: '[::]:8443'
  core.proxy_http: http://proxy-telcocloud.int.inet.telenet.be:8080
  core.proxy_https: http://proxy-telcocloud.int.inet.telenet.be:8080
  core.proxy_ignore_hosts: telenet.be,<IP_ADDRESS>,localhost
  core.trust_password: true
tc@lab-dev-vm-host:~$ lxc image ls ubuntu:
Error: Failed parsing stream: Get "https://cloud-images.ubuntu.com/releases/streams/v1/index.json": Unable to connect to: cloud-images.ubuntu.com:443 ([dial tcp <IP_ADDRESS>:443: i/o timeout dial tcp <IP_ADDRESS>:443: i/o timeout dial tcp [2620:2d:4000:1::17]:443: connect: network is unreachable dial tcp [2620:2d:4000:1::1a]:443: connect: network is unreachable])

Steps to reproduce

configure lxd to use a proxy
block other routes to the internet
run lxc image ls ubuntu:

lxc image ls is done client side, it doesn't talk to the daemon at all.
As a result, it respects the http_proxy and https_proxy environment variables but cannot look at the server configuration.

That's a bit confusing, but OK.
Tested, confirmed to work. Thanks.


Remove SYSFS from udev rules

SYSFS key has been removed a long time ago from udev (in v174), and those rules generate errors that we could get rid of.

Agreed. Those are very legacy statements to support ancient distros.
Let's move on! 👍


[iOS] Create common components

Issue

close #446

Overview (Required)

Create common components in Component module.

Tags
Message Bar
Cards

Small
Medium
Large

This branch still has problem with assetcolor (ref: https://github.com/DroidKaigi/conference-app-2021/pull/454)
Loading Image by url is going to do in other PR because it might have discussion which library to use with.
Links

Figma

Screenshot

Before
After Tag
After Message Bar
After Card Large
After Card Medium
After Card Small

@ry-itto
I've fixed I got in comments. Please re-review! 🙏


how to know either ftp server is able to access or not

how to know either ftp server is able to access or not?
I think using 'browse' is not enough. there is no mention if ftp server is not able to access.
also it's hard to know why ftp is unable to access.

I can get some infomation from consol log 'Ctrl+`', but hope to notice out somewhere in ST


[video_player] add http headers

This enables to pass HTTP headers to VideoPlayerController.network.
Actually this is rebasing @Yarikk26's implementation https://github.com/flutter/plugins/pull/897 on top of video_player 2.0.0.
Fixes: https://github.com/flutter/flutter/issues/16466
Pre-launch Checklist

[x] The title of the PR starts with the name of the plugin surrounded by square brackets, e.g. [shared_preferences]
[x] I read the [Contributor Guide] and followed the process outlined there for submitting PRs.
[x] I read the [Tree Hygiene] wiki page, which explains my responsibilities.
[x] I read and followed the [Flutter Style Guide] and the [C++, Objective-C, Java style guides].
[x] I listed at least one issue that this PR fixes in the description above.
[x] I added new tests to check the change I am making or feature I am adding, or Hixie said the PR is test exempt.
[x] I updated pubspec.yaml with an appropriate new version according to the [pub versioning philosophy].
[x] I updated CHANGELOG.md to add a description of the change.
[x] I updated/added relevant documentation (doc comments with ///).
[x] I signed the [CLA].
[x] All existing and new tests are passing.

As described in CONTRIBUTING.md, video_player in the PR is temporary using overriden video_player_platform_interface_dependency because it isn't published yet

Thanks for picking up this PR! I'll try to take a look in the next week or so.

Looking forward to see that.

@stuartmorgan I fixed all problems you mentioned except removing dependency_overrides in example app. If I remove it now, the example won't compile. Should https://github.com/flutter/plugins/pull/3702 be merged and I remove the override then, right?

Any additional edits needed from me?

Now, as video_player_platform_interface 4.1.0 is published, I removed dependency overrides. Any additional changes needed, @stuartmorgan?

Thank you very much.
I'm going to test it right away :)


How is the Camera input processed?

Hi there,
I stumbled upon a point. How does Apollo process input images from camera?
Are they processed by main computer or directly transferred to GPU to eliminate the overhead? The former case sounds quite inefficient, I could not find myself an answer going through the readme files and the code.
I hope my question was clear, hoping to hear some words from developers.
Thank you all

Closed due to inactivity. If the problem persists, pls feel free to reopen it or create a new one and refer to it.


How to find out there is no ad to show!

Hi there,
Sometimes MagnetSDK Does not provide ads to show in native state and create an ugly empty space in list.
How can find there is ads or not to prevent adding Ads object to adapter?

This is fixed in new version of magnet SDK. Please update your android SDK.

And what about Memory Leak in native state? Does it solved too?

WTF! package name got changed to com.magnetadservices.sdk :|

You are right.
this repo will update as soon.
sorry about that.


App crash on creating Vault

[ ] After creating a Vault a blank screen is appearing with Successful Toast message

[ ] It happens on key rotation aswell

Android 10  RealmeX7

Resolved


fix: fix type: "module" must need js file extensions

PR
PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows our Commit Message Guidelines
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Documentation content changes
[ ] Other... Please describe:

What is the current behavior?

Issue Number: #569
What is the new behavior?
Does this PR introduce a breaking change?

[ ] Yes
[x] No

Other information

Duplicate #1921


need a  quantized model for posenet tensorflow lite

System information
TensorFlow version (you are using): 2.3.1
Are you willing to contribute it (Yes/No): Yes
Describe the feature and the current behavior/state.
There is no quantized model for posenet
Will this change the current api? How?
No
Who will benefit with this feature?
People who need to run pose detection on edge IOT NPUs.
Any Other info.
tensorflow js has a quantized model already, https://github.com/tensorflow/tfjs-models/tree/master/posenet , can we get it in tensorflow lite?

@yangcheng
We see that the issue template has not been filled, could you please do so as it helps us analyse the issue [tf version, steps followed before you ran into this error or stand alone code to reproduce the issue faced]

Thanks, should I mark it as a feature reqeust?

@yangcheng
please explain in details the issue faced and an example code if any.

@Saduf2019 the request is providing a new quantized model for posenet. there is no example code. What kind of detail should I provide here?

Was this solved? Did you find a quant posenet model?

Was this solved? Did you find a quant posenet model?

Hi @yangcheng !Have you checked INT8 and FP16 quantized models from MoveNet for pose estimation?

I was using MLKit for now.
Thanks for the information. I'll take a look at movenet now!

@yangcheng ! Shall we move this feature request to closed status ?


Missing space character in css minification causes rendering issues in WebKit

Hi,
minifying "-webkit-text-size-adjust: none;" removes the space character and breaks WebKit rendering. Confirmed for Safari 5, Safari 9.1 and Midori 0.5.11. Safari 10 and other modern browsers appear to correct this bug.
I have manually tested the current version of minify/lib/Minify/CSS/Compressor.php and it does strip the space character.

Hi, Minify now uses CSSMin from a separate project. Here's the docs for using this in Minify 2.x: https://github.com/mrclay/minify/blob/a36e201ab285ac6208e077a295da15041035e35e/docs/CookBook.wiki.md#cssmin-php-port


Public interface now contains unintended libcore modules

On master now the root module now reexports via pub use a number of modules, but these aren't intended to be part of the public interface of the libc crate. I was wondering if this was a mistake perhaps?

Clone, Copy and Option shouldn't be pub if private module use is available (looks like a C&P error, but those are hidden). But using pub use is required to build in Rust < 1.15.0, where private module use was not available.

Ah ok, I think it's probably fine to "expand" the public API on older versions of Rust which are probably no longer in use. Should these pub statements be removed though?

Should these pub statements be removed though?

Yes, see https://github.com/rust-lang/libc/pull/1269

Ah ok, I think it's probably fine to "expand" the public API on older versions of Rust which are probably no longer in use

I am not sure how libc did it back then, but when trying to compile on Rust 1.13.0, it only compiled for x86_64-unknown-linux-gnu, which was the only target tested, and for that toolchain the build was broken on most other targets due to this issue (private module use).
Exporting those items fixed that, but maybe it should be a hint that we should raise the minimum supported libc version at some point, since the build was broken, and nobody was complaining.

Eh well in any case this should be fixed now, thanks!


ZEPPELIN-172 Websocket connection without separate port

This PR fixes https://issues.apache.org/jira/browse/ZEPPELIN-172

Didn't try it yet,
But front part is well changed and Overall looks like a nice job.

Ready to merge

There is a couple of other things related to Websocket, do you think this could be handled in this PR too? Security: https://issues.apache.org/jira/browse/ZEPPELIN-173
PingPong: https://issues.apache.org/jira/browse/ZEPPELIN-113 (Last comments)

I have created an pull request cleaning it up some more: https://github.com/Leemoonsoo/incubator-zeppelin/pull/2

Thanks @sjoerdmulder

Ready to merge

merging if there're no more discussions.

Go for it :) +1


usb.core.USBError Errno 75 Overflow

Occured when using zbwireshark to capture the zigbee unlock door packet command as below
pyusb version 1.0.1
cc2531 firmware 2.1r1
Any help ,Suggestion ?
Thank you.
└─$ sudo zbwireshark -c 25
\Auto-detection is being deprecated - Please specify hardware
Warning: You are using pyUSB 1.x, support is in beta.
zbwireshark: listening on 'CC2531 USB Dongle', channel 25, page 0 (2475.0 MHz), link-type DLT_IEEE802_15_4, capture size 127 bytes
Error args: (75, 'Overflow')
Traceback (most recent call last):
File "/usr/local/bin/zbwireshark", line 4, in
import('pkg_resources').run_script('killerbee==3.0.0b2', 'zbwireshark')
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 656, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/usr/lib/python3/dist-packages/pkg_resources/init.py", line 1453, in run_script
exec(code, namespace, namespace)
File "/usr/local/lib/python3.10/dist-packages/killerbee-3.0.0b2-py3.10-linux-x86_64.egg/EGG-INFO/scripts/zbwireshark", line 108, in
main()
File "/usr/local/lib/python3.10/dist-packages/killerbee-3.0.0b2-py3.10-linux-x86_64.egg/EGG-INFO/scripts/zbwireshark", line 84, in main
packet = kb.pnext()
File "/usr/local/lib/python3.10/dist-packages/killerbee-3.0.0b2-py3.10-linux-x86_64.egg/killerbee/init.py", line 442, in pnext
return self.driver.pnext(timeout)
File "/usr/local/lib/python3.10/dist-packages/killerbee-3.0.0b2-py3.10-linux-x86_64.egg/killerbee/dev_bumblebee.py", line 400, in pnext
self.process_rx()
File "/usr/local/lib/python3.10/dist-packages/killerbee-3.0.0b2-py3.10-linux-x86_64.egg/killerbee/dev_bumblebee.py", line 156, in process_rx
raise e
File "/usr/local/lib/python3.10/dist-packages/killerbee-3.0.0b2-py3.10-linux-x86_64.egg/killerbee/dev_bumblebee.py", line 149, in process_rx
nbytes = self.dev.read(Bumblebee.EP_IN, self.usb_rx_buffer, 10)
File "/usr/local/lib/python3.10/dist-packages/usb/core.py", line 983, in read
ret = fn(
File "/usr/local/lib/python3.10/dist-packages/usb/backend/libusb1.py", line 828, in bulk_read
return self.__read(self.lib.libusb_bulk_transfer,
File "/usr/local/lib/python3.10/dist-packages/usb/backend/libusb1.py", line 936, in __read
_check(retval)
File "/usr/local/lib/python3.10/dist-packages/usb/backend/libusb1.py", line 595, in _check
raise USBError(_strerror(ret), ret, _libusb_errno[ret])
usb.core.USBError: [Errno 75] Overflow

Trying the python 2
ps bumblebee doesn't support cc2531 anymore .

Hm not sure about why your command files, but you can also try using zbdump. That's what I use to capture packets and then afterwards open them in wireshark.

Unfortunately, this is a known bug of this firmware, sometimes it triggers this kind of error on libusb because I think I'm doing it wrong at some point in the code. The more Zigbee devices in the area the more often it happens, other contributors reported.


x/build/cmd/coordinator: support builders that only run on subrepos

It's currently not possible to configure a builder that only builds a subrepo(s) and not the "go" repo.
This is affecting linux-amd64-androidemu and darwin-amd64-wikofever which aren't building the mobile repo currently, despite being configured to do so.
Two reasons why they aren't:

subrepos always wait for a make.bash snapshot (this should be conditional on "go" being configured to even run for that repo)
because https://build.golang.org/ never populates the subrepo tables' columns with a builder name if it doesn't also show up in the top ("go") table. And the coordinator uses a json version of that same page (https://build.golang.org/?mode=json) to find work to do.

For the first, it should also be possible to say that a given builder can also use a built make.bash from a different builder. e.g. linux-amd64-androidemu can use a built make.bash tarball from linux-amd64.
/cc @eliasnaur @dmitshur

Perhaps it's easier if the builder is allowed to build "go" for snapshots but not run std tests? I don't know if your second point is also solved then.

But then it's more spammy width in the build.golang.org top table.


ACAD10

When working on #726, I noticed that ACAD10 (ENSG00000111271) is currently associated with only two reactions in Human-GEM:

ID
reaction
GPR

MAR03212
FAD [m] + propanoyl-CoA [m] --> acrylyl-CoA [m] + FADH2 [m]
ACAD10 or ACADM or ACADS or ACAD8 or ACAD9 or ACADSB or ACAD11

MAR03163
butyryl-CoA [m] + FAD [m] --> crotonyl-CoA [m] + FADH2 [m]
ACAD10 or ACADM or ACADS or ACAD8 or ACAD9 or ACADSB or ACAD11

Uniprot says ACAD10 can only act on (R)- and (S)-2-methyl-pentadecanoyl-CoA, citing this paper. From the end of the paragraph under the section heading "Prokaryotic expression of ACAD10 and ACAD11" of that paper:

Extracts from cells expressing a predicted mature mitochondrial ACAD10 insert were only active with R and S, 2 methyl-C15-CoA (R and S, 2-methyl-pentadecanoyl-CoA) among a broad series of other substrates including the optimum ones for all of the other ACADs. The measured activity (1.4 mU/mg at 150 μM substrate concentration) is considerably lower than that obtained with other expressed ACADs towards their optimum substrates, suggesting that the dehydrogenation reaction between ACAD10 and R or S, 2 methyl-C15-CoA is unlikely the optimal function for ACAD10 in vivo.

I can't seem to find any other papers that ever showed that ACAD10 can act on propanoyl-CoA, butyryl-CoA, or anything else. Also Human-GEM does not already seem to have a metabolite for 2-methyl-pentadecanoyl-CoA; the closest I can find is pristanoyl-CoA (MAM00078x), i.e. 2,6,10,14-tetramethylpentadecanoyl-CoA, but that's known to be oxidized by peroxisomal beta-oxidation (source), and ACAD10 seems to be localized to mitochondria, or at least not localized to peroxisomes (source).
I think ACAD10 should be removed from the GPRs of MAR03212 and MAR03163 and also removed from Human-GEM altogether.
This is slightly redundant with the proposed changes in #634, since both reactions are also associated with ACAD11, which is localized to peroxisomes, but the metabolites are all mitochondrial, and #634 proposes new GPRs that only contain genes that code for mitochondrial proteins known to catalyze this kind of reaction.

@Devlin-Moyer thanks for collecting the evidence, in which the statement "ACAD10 insert were only active with R and S, 2 methyl-C15-CoA among a broad series of other substrates including the optimum ones for all of the other ACADs" supports the removal of MAR03212 and MAR03163, as well as Human-GEM

fixed by #740


Change default queries for backup/restore

When I've tried to use dbeaver to backup my remote server, and then, restore it in my local machine, I've found an error:
This is the default query executed when I've tried to backup my server:
# Didn't work
pg_dump \
  --verbose --host=<IP_ADDRESS> --port=5433 --username=postgres \
  --format=p --encoding=UTF-8 -n public pmi

However, for some reason, it fails when I've tried to restore it.
In my local test, I noticed that the problem was caused by the param -n public, i.e, when I execute the same instruction, without passing -n public, the dbeaver can execute the query successfully.
pg_dump \
  --verbose --host=<IP_ADDRESS> --port=5433 --username=postgres \
  --format=p --encoding=UTF-8 -W pmi > db.sql

I wanna know if there's some config hidden in Dbeaver that i can change to make it works, some config file, or something like that.

Hello @ppcamp. It's quite strange that the -n causes problems, seem more like a bug. Could you please tell me which version of PostgreSQL you use and your OS, and what kind of error DBeaver shows when it fails to restore the database? Thank you.

Hi @akilovich , what's up? Sorry about the mistake when I was putting the flags. In fact, given the origin of the problem, I thought that it shouldn't be there.

OS: Kubuntu 20.10; 5.8.0-44-generic #50-Ubuntu SMP Tue Feb 9 06:29:41 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Remote OS:  Ubuntu 20.04; 5.4.0-52-generic #57-Ubuntu SMP Thu Oct 15 10:57:00 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Local Postgres (Running over docker): PostgreSQL 12.5 (Debian 12.5-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit
Remote Postgres (Connecting over ssh tunneling): PostgreSQL 12.6 (Ubuntu 12.6-0ubuntu<IP_ADDRESS>) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0, 64-bit

Using "Plain" in backup format:
When I backup with flag -n public (dbeaver approach), and try to restore it using the option Execute script, it freezes, forcing me to stop the execution, throwing the following log:

ALTER TABLE

Task 'PostgreSQL script' finished at Thu Feb 25 11:02:08 BRT 2021
2021-02-25 11:02:09.070 - IO error: Process failed (exit code = 143). See error log.
2021-02-25 11:02:09.072 - java.io.IOException: Process failed (exit code = 143). See error log.
	at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.validateErrorCode(AbstractNativeToolHandler.java:214)
	at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.executeProcess(AbstractNativeToolHandler.java:194)
	at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.doExecute(AbstractNativeToolHandler.java:254)
	at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.lambda$0(AbstractNativeToolHandler.java:60)
	at org.jkiss.dbeaver.runtime.RunnableContextDelegate.lambda$0(RunnableContextDelegate.java:39)
	at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:122)

Using "Directory" format:
In this approach, dbeaver will use pg_restore, and when doing so, it throws:

pg_restore: warning: errors ignored on restore: 445

Task 'PostgreSQL restore' finished at Thu Feb 25 11:05:18 BRT 2021

Which do not restore it.

Dbeaver version: <IP_ADDRESS>102141704

Obs.: Like I said before, if i make a backup manually and run it (using the same psql client version and without -n public), it run successfully.
Obs2: The error occurs using flatpak and *deb versions.

That seems to be the misconception that a plain backup (setting pg_dump --format=p) can be restored with pg_restore. But it isn't. The parameter "--format=p"  generates a plain sql script that you need to execute using the psql command line client instead of pg_restore.
So as a workaround, if you want to restore your backup, you can use DBeaver's execute sql script functionality:

The fix on DBeaver's side would be to trigger psql instead of pg_restore, if a plain backup is to be restored.
Hope this helps!

Hello, I just figured out why this happens and wanted to provide the info here in case it helps whomever is going to write the fix.
The issue is that when specifying a schema (using -n as mentioned above) pg_dump will not dump all objects. For me the issue happened because I had a few extensions installed. The restore would fail because I was referencing those extension's types within tables in the public schema. This caused errors. I found this SO issue which led me to the problem (see number 3): https://stackoverflow.com/questions/44442248/pg-dump-does-not-write-create-extension-postgis

@charlieblevins
Ah! So, the whole problem was because I was using uuidv4. Indeed, I didn't think about it. Thanks a lot!

Hello @ppcamp
To avoid the -n flag, you can use pg_dumpall - the "Global Backup".

Please let me know if it helps.

Hey @LonwoLonwo , probably it'll help. I think that this is a new feature introduced after that time that I've openned this issue (2 years ago). Therefore, I'm closing this.


LibGfx: Use actual vector size as indicated by HarfBuzz

This fixes a browser crash as experienced on Wikipedia when encountering the ≠ entity. As a side-effect, this also affects some tab-align and -wrap tests.
In particular, harfbuzz keeps changing the internal buffer array around, and writes to glyph_count in the later calls, so it's a bad idea to use the first value and use it forever.
CC @kostyafarber, as I this seems to change(?) or break(?) a test that you recently added in #1691.  If yes, how do we fix this?

Oh no, I'm sorry ^^'

(fix attempt reverted in fdfbfcab37d679e0b59a0573706490c458d3fd55, this PR reverted in 325ff4ac276ff2805a65c154d3f77af321c72717)


Fixed crash when an NSBundle without executable is loaded

Fixes #980

Looks good, restarted Travis to make sure it passes. Will merge as soon as it passes.


Memory limiter in Querier

DRAFT - NOT FOR MERGE
This PR is a first demo of the fix for #1625.
It is here for:

Demonstrate the nature of the fix;
Discuss and agree if this is how we broadly want to implement it. Or some other way.

Note:

The code for the fix can probably be in better place;
There are some hard-coded values and TODOs for now.

Changes
Small changes to github.com/thanos-io/thanos/pkg/store/proxy.go.
Verification
Using manual test. Querier logs show this:
level=error ts=2019-10-11T10:31:34.215101Z caller=proxy.go:203 err="OOM preventor: exceeded max memory. Max: 2048.00M; Current: 2048.23M"
level=error ts=2019-10-11T10:31:34.215354Z caller=engine.go:596 msg="error selecting series set" err="proxy Series(): OOM preventor: exceeded max memory. Max: 2048.00M; Current: 2048.23M"
level=warn ts=2019-10-11T10:31:34.215528Z caller=proxy.go:447 err="failed to receive any data from Addr: localhost:10901 LabelSets: [] Mint:<PHONE_NUMBER>000 Maxt:<PHONE_NUMBER>001: context canceled" msg="returning partial response"

@bwplotka

...This will indeed potentially keep Querier running by failing ALL the requests pending in Querier.

Good point. There are really many flaws with this naive simple approach really. The only aim here is to prevent OOM as step1 and then see what else we can do to make things better.
Ideas how to take this further:

Some kind of logic where we kill one query in the hope this frees up room for others. For example, if memcheck detect nomem condition, it returns error to the first caller. Then waits a bit, runs GC, while blocking other callers. All this in the hope that the query that was killed freed up enough memory for others to proceed. This probably relatively easy to do.

Per-query accounting. Would be nice. But I think it's quite difficult to do without very impactful changes. At least I don't have a clear picture of how this can be done at the moment without more digging around. The only idea I have is some kind of custom arena memory manager (basically massive byte slice) which gives out sub-slices and through which everything goes.

BTW, how is that different from OOM? ((:

OOM is a bug, and this is a feature! :}}
I see your point though. The difference is:

OOM gives a really bad impression to the users; Here at least we try to do a bit better.
OOM is not always easy to see -- stuff just dies. Depending on how/where you run it, need to look at different places to check if it's OOM or something else. Here we have log message.
Other things may depend on the Querier. Do they get "connection reset by peer" when it OOMs? Here they won't.
Restart may be quick, but it still takes time. Also, in k8s it will be another pod, which will do +1 for cardinality of metrics. Here we avoid it.

Not arguing much with what you pointed out, this fix is a stop-gap safety valve feature really, not much more at this point.

It looks to me that we are focusing on the opposite direction of the value. We are implementing some blackbox OOM killer, instead of trying to understand the data and what's happening, how much data we are actually fetching vs allocating, where we can stream more. But that's only my opinion. I think I am happy for you to experiment with this as long as it does not introduce a huge maintenance burden/problem over time for Thanos project (:  f you/users feel it's valuable, we can definitely try it out and check how it goes, add more logic to this blackbox solution.

Per-query accounting. Would be nice. But I think it's quite difficult to do without very impactful changes. At least I don't have a clear picture of how this can be done at the moment without more digging around. The only idea I have is some kind of custom arena memory manager (basically massive byte slice) which gives out sub-slices and through which everything goes.

Yup, that is called heap (: There is sync Pool that tries to help if you have similar sizes of the byte slices. There is also https://github.com/glycerine/offheap but it might be too complex FWTW. There is also this: https://github.com/VictoriaMetrics/fastcache

I agree there is a lot that can be done in this space. Hopefully issue #1625 is just the first step as it does at least highlights that all responses from SG look to be copied into internal array before given out to the client (unless I forgot to mention it there?).
Maybe we should build a list of things to explore and think about, along these lines:

why does it not stream out the results? is it something to do with deduplication perhaps? aggregation?
what else can be done to optimise this?
can we do something to prevent knowingly bad queries?
can SG help make queries better by taking doing slightly more work?
etc

Do people think this would be the right approach to take?

I agree with @bwplotka here I think we are going in the opposite direction here with this memory limiter. I would rather we have some kind of solution in a style of https://landing.google.com/sre/sre-book/chapters/addressing-cascading-failures/#xref_cascading-failure_preventing-server-overload
Maybe adding a limited queue instead of processing all requests, giving requests with larger time windows bigger cost's etc?
I would also look at what Cortex people did to prevent overload, maybe we can reuse some of their stuff.

I concur with others. It doesn't seem to me like stopping the world and calculating the allocations is a good way to go forward with this. Besides the comments about streaming more and so on, I had a small idea: we should handle panics in the separate goroutines which handle requests and disable overcommit to prevent the Linux kernel from allocating memory opportunistically. Then we would fail huge requests early. WDYT?

So, if we could put limits on individual queries that would be better, right? :)
Had a super quick look at Cortex, here is the config right there in the querier. Looks like they have limits on max concurrent queries and max samples.
// Config contains the configuration require to create a querier
type Config struct {
	MaxConcurrent            int
	Timeout                  time.Duration
	MaxSamples               int
	IngesterMaxQueryLookback time.Duration
....
}

Am I even looking in the right place?
https://github.com/cortexproject/cortex/blob/20d3af237bff4db91ca20d850ab5413faf1949d7/pkg/querier/querier.go#L20

Looks like they have limits on max concurrent queries and max samples.

Yup, but that's not enough. Store GW had this and it was not enough. I think on top of this there might be max series which could be interesting. Cardinality is the largest source of memory use. Also, keep in mind that users start to use frontend query caching. This changes a characteristic of traffic against Querier a lot, as it splits queries by day - maybe we can take that as an advantage?

I had a small idea: we should handle panics in the separate goroutines which handle requests and disable overcommit to prevent the Linux kernel from allocating memory opportunistically. Then we would fail huge requests early. WDYT?

@GiedriusS, could you elaborate please?

I will close this as it's clearly not the way to go. Instead I've opened a new discussion issue to have a central list the ideas and talk through them in one place.  See https://github.com/thanos-io/thanos/issues/1649
If there are better ways to do it rather than GitHub issues, please let me know, I'm more than happy to switch to that.


[WIP]ISSUE-185: Init e2e README.md

https://github.com/kubernetes/federation/issues/185

Hi, please get your CLA signed, and we will ok this for testing. Thanks!

Thank you!
На 3.03.2018 г. 4:01 "Jaice Singer DuMars"<EMAIL_ADDRESS>написа:
Hi, please get your CLA signed, and we will ok this for testing. Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes/federation/pull/186#issuecomment-369983344,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AI_e6cyEQdKEgOH_0CFRli2kMCF5qd1sks5taXrpgaJpZM4RW4Qe
.

Hey!
I am sorry, but I think I already did sign it... will check again.
Apologies for the delay, moved countries recently.
Looking forward to getting this finished.

OK so it seems my commits are missing my email, which is causing the issue with the CLA. fixing..

Thanks @nikox94 for doing this.
/lgtm

/retest

OK @shashidharatd , please ping me when it's done

/ok-to-test

This seems to be nice to have.
/reopen


API Gateway integration - 5xx Error

I have managed to deploy the hello world example. However i would like to integrate the lambda with API Gateway. I have created my API gateway method and choose the golang lambda function but i get "message": "Internal server error" when i call the http endpoint from postman.

@iNDicat0r have you tried the integrated solution we provide (https://github.com/eawsy/aws-lambda-go-net) for API Gateway using this shim?

Thanks I wasn't aware of this(Needs proper documentation). A quick question, why is the handlers size that big ?

Because of golang/go#17150 :smile:


Merge Models and OSes

We have a lot of duplicates in both the Models and OSes tables, some are variant misspellings, others are exact dupes.  We could clean it up a lot if there were a way to merge them (delete all but one, move all references to the one that's kept)

It's not as easy to just merge them automatically. There was so much garbage data in SN from autodiscovery and user entries that many similar entries have been imported.
I can run a query to delete any entries that are unused.
There are currently only 14 unused server models that can be deleted:
select id from server_models where id not in (select server_model_id from systems where server_model_id is not null);
There are currently 157 operating system that can be deleted
select id from operating_systems where id not in (select operating_system_id from systems where operating_system_id is not null);
There aren't many exact dupes as far as server_models go
MariaDB [inventory_mozilla_org]> select id, vendor,model, count() from server_models group by vendor,model having count() > 1;
+------+-------------+----------------+----------+
| id   | vendor      | model          | count(*) |
+------+-------------+----------------+----------+
|  157 |             |                |        2 |
| 1449 | Cisco       | WS-C3850-24S-E |        2 |
| 1436 | PAN PA-3020 | PAN PA-3020    |        8 |
+------+-------------+----------------+----------+
There are no dupe operating systems
MariaDB [inventory_mozilla_org]> select name,version, count() from operating_systems group by name,version having count() > 1;
Empty set (0.00 sec)
3 rows in set (0.00 sec)
I can run queries to update these exact dupes but ones that are  just barely off should be manually fixed as they are found.

delete from server_models where id not in (select server_model_id from systems where server_model_id is not null);
delete from operating_systems where id not in (select operating_system_id from systems where operating_system_id is not null);

This drastically reduced the amount of crap entries

@justdave if you want to go through now and tell me which entries to update I can run some SQL manually.
If you go to the server model list page and hover over the edit link you can get the id number of the proper and the incorrect entries. I can then easily run sql updates.
The following is a great example from inventory. (ID is the numeric part of the edit link):
Vendor | Model | ID
PAN | PA-220 | 1435
PAN PA | 220 |1439
You can tell me to update all 1439 to 1435 and then delete 1439.
Let me know if this makes sense.

| 1449 | Cisco | WS-C3850-24S-E | 2 |
| 1436 | PAN PA-3020 | PAN PA-3020 | 8 |

Hey, those are the two I actually noticed that prompted this issue being filed. :-)

Vendor | Model | ID
PAN | PA-220 | 1435
PAN PA | 220 |1439
You can tell me to update all 1439 to 1435 and then delete 1439.

That works for me. :-)  Thanks!

There were a few of the variant misspelling variety IIRC but I'm out for a couple weeks, I'll investigate again when I'm back, and ask for those specifically when I find them again.


python: interpreter package not reproducible

Building the python interpreter twice does not produce the bit-by-bit identical result each time, making it harder to detect CI breaches.
For more background on the cause(s) of this problem, see #120858 and further resources linked there.
Notably, the remaining known upstream issue (https://github.com/python/cpython/issues/81777) has been fixed in Python 3.11, so we should verify the problem remains after bumping the default python version to 3.11.
Anecdotally, on nixpkgs 6512b21eabb4d52e87ea2edcf31a288e67b2e4f8 nix-build --check '<nixpkgs>' -A python311 indeed succeeded for me, which is promising.

(python 3.11 is planned to become the default on unstable after the release of 23.05, following https://github.com/NixOS/nixpkgs/blob/master/doc/languages-frameworks/python.section.md#cpython-update-schedule)

python 3.11 is planned to become the default on unstable after the release of 23.05

This is now on its way in #251878 / https://nixpk.gs/pr-tracker.html?pr=251878


Add support for Customer Managed Encryption Key

What this PR does / why we need it:
Add support for The Customer Managed Encryption Key used to encrypt the boot disk attached to each node in the node pool.
For more information about protecting resources with Cloud KMS Keys please see:
https://cloud.google.com/compute/docs/disks/customer-managed-encryption
Which issue(s) this PR fixes
Issue: https://github.com/rancher/gke-operator/issues/261
Special notes for your reviewer:
Checklist:

[x] squashed commits into logical changes
[x] includes documentation
[x] adds unit tests
[x] adds or updates e2e tests
[x] backport needed

Sorry for late reply, LGTM


Update README.md

Add descriptions of 2 packages.
Add comments on FilesSearcher.java.
Add Usage part.

I think we'd better add some important notes in README.mf

Thanks for your attention,  that's a good fix of README.mf !


Support for StepFunctions service

Describe the feature
Please add support for StepFunctions.
Use Case
Its an AWS service and is supported in other SDK,
please see JS SDK for reference: https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/StepFunctions.html
I do use state machines and "I am always frustrated" when I cannot do it in Swift :-)
Proposed Solution
Add StepFunctions to the list of generated services
Other Information
No response
Acknowledgements

[ ] I may be able to implement this feature request
[ ] This feature might incur a breaking change

I missed that the StepFunctionsClient is SFNClient from AWSSFN package


jobs might be a typo for job in Context availability

Code of Conduct

[X] I have read and agree to the GitHub Docs project's Code of Conduct

What article on docs.github.com is affected?
https://docs.github.com/en/actions/learn-github-actions/contexts#context-availability
What part(s) of the article would you like to see updated?

Workflow key
Context
Special functions

concurrency
github, inputs

jobs.<job_id>.steps.working-directory
github, needs, strategy, matrix, job, runner, env, secrets, steps, inputs
hashFiles

on.workflow_call.outputs.<output_id>.value
github, jobs [s.b job ?], inputs

Additional information
No response

Thanks @jsoref! I'll mark this for someone to review to confirm.

Not a typo..., but unclear / incomplete documentation
on:
   workflow_call:
     outputs:
       A:
         value: ${{ jobs.my_job.outputs.A }} # jobs is equivalent to the needs context and has the same structure, but includes all jobs in the current workflow file
jobs:
  my_job:
    outputs:
      A: MyOutput
    runs-on: ubuntu-latest
    steps:
    - run: exit 0

Indeed, so, it isn't that it's a typo, it's that the jobs context isn't listed on this page at all.
Obviously, it should be.
I'll change the issue description after we get confirmation...

👋 Thanks for opening this issue!
🤔 Yes, this is a bit complicated. For regular workflows, there is no jobs context. The jobs context only applies to reusable workflows (i.e. workflows with an on.workflow_call trigger), but I'm not 100% sure on where it can be used or what's in it; it might only be available to set outputs in the called workflow. I'll have to check in with engineering.

@lucascosti Thats right, this is available for reusable workflows while setting the output values.
Something like this:
 workflow_call:
    outputs:
      output1:
        value: ${{ toJSON(jobs.job1) }}
      output2:
        value: ${{ toJSON(jobs.job2) }}

and output1 data can look like:
{
  result: success,
  outputs: {
    output1: hello2,
    output2: world2
  }
}

@lucascosti, technically the document already warns users about this:
https://docs.github.com/en/actions/learn-github-actions/contexts#context-availability

Different contexts are available throughout a workflow run. For example, the secrets context may only be used at certain places within a job.
In addition, some functions may only be used in certain places. For example, the hashFiles function is not available everywhere.

Now, it's probably true that this text is way too far down the document.
I'd argue that the structure should be:

About contexts (the stuff before the pink box in https://docs.github.com/en/actions/learn-github-actions/contexts#about-contexts)
Availability disclaimer (https://docs.github.com/en/actions/learn-github-actions/contexts#context-availability)
List of contexts -- with its own anchor so I can link to it (the stuff after the pink box in https://docs.github.com/en/actions/learn-github-actions/contexts#about-contexts)

I don't have a particular opinion about where to put the pink box.
It sounds like the description of the jobs context is:
jobs context
The jobs context provides information about other jobs in the workflow.

Property name
Type
Description

<job_id>.result
string
The result of the job.

<job_id>.outputs
object
The set of outputs defined for the job. For more information, see "Metadata syntax for GitHub Actions."


Why is font_to_py.py modified?

This program has had numerous improvements over the last three years thanks to input from a number of users.
I'm baffled as to why you include get_width() in the font file. In my work this function lives in the display driver. The use of a modified version has caused confusion in the forum. Might I suggest you reconsider this decision?
If there is a technical reason for including this method, I will consider updating my format to include it.

Hi Peter, I have not touched this driver for over three years now. The reason why I put getWidth in the font was that as far as I remember it had something to do with efficiency. I am afraid that I am not in a position to test a modified version but would be happy if someone else wants to.
With regards to confusion - it is documented.....
I am quite surprised that it has been used so much as I found it fairly slow.

It is worth noting that the requirement for get_width is more involved than at first sight. This is because some glyphs have trailing whitespace. After feedback from users who noted that widths were sometimes overstated, I implemented a revised algorithm in the Writer class. I don't plan to include this in my font file format. Users might choose to use a simpler, less precise but faster algorithm such as yours. My view remains that this code should be located elsewhere than in the font file.
It seems unfortunate that three years of development is lost. Aside from bug fixes, notable improvements are implementation of sparse fonts, better support for foreign character sets and support for minimal character sets such as a digital clock set. Also, relevant to tiny displays, support for bdf and pcf font files (i.e. hand drawn bitmapped font files). Sooner or later someone is going to try to use these features only to find them fail.
My approach would be to fork font_to_py.py rather than maintaining an independent version. That enables you to include your adaptation while ensuring that merging changes in master is trivially easy.
If you've moved on to other things, fair enough.

I take your point entirely about accessing the latest version. I would prefer to not have a separate version of your excellent font_to_py program. Would there be any chance of you adding an option to output the get_width function so that I can refer to your repository directly. I think that the point of having get_width in the font file is the same as having the get_ch function in the font file. It avoids having to know details of the font file structure in the driver.

A get_width function does not need to know details of the font file structure: it can use the documented fact that get_ch returns the width of the current glyph along with the glyph itself.
As I pointed out above, there is a choice of algorithms for get_width depending on whether you want to prioritise speed or accuracy. You might like to look at my stringlen and the _truelen method it calls to see what is involved in getting an accurate determination of length.
In many applications simply summing the glyph widths returned by get_ch would provide a good enough width, faster and with less code. In my view this choice between two equally legitimate approaches rules out incorporating the function into the font.
Looking at the font in your repo suggests your version of font_to_py.py is modified as your get_ch function returns only two values. Mine returns three, and has done since first posted. It returns the glyph followed by height and width. See the docs. I agree that there is no real need to return height, but I didn't want to foist a breaking change on users. Please bear this difference in mind if you do update.

OK, let’s agree to disagree. Calling get_ch to get the width adds an extra level of function calls which is the efficiency reason I added get_width in the first place.

By the way, the font_to_py works if you cut and paste the last three functions of the downloadable fonts that come with the ili934Xnew.py and paste them into the font produced by font_to_py.


bug: target table is being reset after a successful sync, then completes without logging an error

Meltano Version
3.1.0
Python Version
3.10
Bug scope
Other
Operating System
Linux Ubuntu 22
Description
sync reset's table after completing successfully and it seems to want to start afresh but it completes without any error.
It initially synced over 500k records before resetting and adding some 9k records before completing without logging any error.
I suspect this is happening on the   near end of the log attached where it says " Cleaning up db_schema-locations"
Code
version: 1
default_environment: dev
project_id: 2951a9a9-6eb5-4526-8f96-b10d22c2be8f

environments:
- name: dev
- name: staging
- name: prod

plugins:
  extractors:
  - name: tap-mysql
    variant: transferwise
    pip_url: pipelinewise-tap-mysql
    select:
    - schema-locations.*
    metadata:
      schema-locations:
        replication-method: LOG_BASED

  loaders:
  - name: target-clickhouse
    variant: shaped-ai
    pip_url: git+https://github.com/shaped-ai/target-clickhouse.git

2023-12-09T19:57:01.285373Z [info     ] 2023-12-09 22:57:01,285 | INFO     | target-clickhouse    | Target sink for 'db_schema-locations' is full. Draining... cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:01.966531Z [info     ] 2023-12-09 22:57:01,965 | INFO     | target-clickhouse.db_schema-locations | Inserting with SQL: INSERT INTO test_schema.locations cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:01.967530Z [info     ] (duration, playback_session_id, platform_id, device_platform_version, internet_connection, device_manufacturer, user_id, playable_id, longitude, id, app_version, playable_type, address, event, country, content_category, device_model, created_at, updated_at, device_platform, sub_user_id, playback_time, type, ip, latitude) cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:01.968338Z [info     ] VALUES (:duration, :playback_session_id, :platform_id, :device_platform_version, :internet_connection, :device_manufacturer, :user_id, :playable_id, :longitude, :id, :app_version, :playable_type, :address, :event, :country, :content_category, :device_model, :created_at, :updated_at, :device_platform, :sub_user_id, :playback_time, :type, :ip, :latitude) cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:03.005703Z [info     ] time=2023-12-09 22:57:03 name=singer level=INFO message=METRIC: {"type": "counter", "metric": "record_count", "value": 109503, "tags": {"database": "db_schema", "table": "locations"}} cmd_type=elb consumer=False name=tap-mysql producer=True stdio=stderr string_id=tap-mysql
2023-12-09T19:57:03.006572Z [info     ] time=2023-12-09 22:57:03 name=singer level=INFO message=METRIC: {"type": "timer", "metric": "job_duration", "value":<PHONE_NUMBER>3859863, "tags": {"job_type": "sync_table", "database": "db_schema", "table": "locations", "status": "succeeded"}} cmd_type=elb consumer=False name=tap-mysql producer=True stdio=stderr string_id=tap-mysql
2023-12-09T19:57:06.041006Z [info     ] 2023-12-09 22:57:06,040 | INFO     | target-clickhouse    | Target 'target-clickhouse' completed reading 582665 lines of input (1 schemas, 582077 records, 0 batch manifests, 585 state messages). cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:06.597018Z [info     ] 2023-12-09 22:57:06,596 | INFO     | target-clickhouse.db_schema-locations | Inserting with SQL: INSERT INTO test_schema.locations cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:06.597761Z [info     ] (duration, playback_session_id, platform_id, device_platform_version, internet_connection, device_manufacturer, user_id, playable_id, longitude, id, app_version, playable_type, address, event, country, content_category, device_model, created_at, updated_at, device_platform, sub_user_id, playback_time, type, ip, latitude) cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:06.598541Z [info     ] VALUES (:duration, :playback_session_id, :platform_id, :device_platform_version, :internet_connection, :device_manufacturer, :user_id, :playable_id, :longitude, :id, :app_version, :playable_type, :address, :event, :country, :content_category, :device_model, :created_at, :updated_at, :device_platform, :sub_user_id, :playback_time, :type, :ip, :latitude) cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:07.515184Z [info     ] 2023-12-09 22:57:07,514 | INFO     | target-clickhouse.db_schema-locations | Cleaning up db_schema-locations cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:07.517276Z [info     ] 2023-12-09 22:57:07,515 | INFO     | target-clickhouse    | Emitting completed target state {"currently_syncing": null, "bookmarks": {"db_schema-locations": {"version":<PHONE_NUMBER>338, "log_file": "mysql-bin.000008", "log_pos": 62472502, "gtid": "49569077-2635-11ee-8f72-6045bddb2dee:1-1589"}}} cmd_type=elb consumer=True name=target-clickhouse producer=False stdio=stderr string_id=target-clickhouse
2023-12-09T19:57:07.732261Z [info     ] Incremental state has been updated at 2023-12-09 19:57:07.731831.
2023-12-09T19:57:07.870317Z [info     ] Block run completed.           block_type=ExtractLoadBlocks err=None set_number=0 success=True

@gkarugi Gotcha, thanks for sharing the debug log!
That confirms the culprit in https://github.com/shaped-ai/target-clickhouse/blob/f70e4a7f92162922dae0d7936639c794a837d41e/target_clickhouse/sinks.py#L114-L122.
The target copied the reference implementation in the SDK: https://github.com/meltano/sdk/blob/40b633385b3ec5462d90042213bfb236c57ccbab/singer_sdk/sinks/sql.py#L381-L389
So fixing this probably involves:

Temporarily patching target-clickhouse by submitting a PR to change <= for <.
Changing the SDK's default to perform soft-deletes.
Fixing the SDK's implementation to make the filter <, not <=.
Add a new connector method delete_old_versions that target-clickhouse can override in the next release of the SDK.

PS I've transferred the issue to meltano/sdk

Hello @edgarrmondragon Thanks for your help with this. I am just starting out with Meltano, so didn't have an idea where I should start debugging.

I tested passing the config hard_delete: false. This fix worked.
`- But a point to note, for a fresh sync, one needs to truncate or delete the DB table.
changing <= to < as shown below didn't work as expected, the table got deleted anyway. I added logging and
the WHERE clause translates to WHERE _sdc_table_version <1702988238996 .  All records have 0 on the _sdc_table_version  column, so this check is always true, and I think prompts it to delete the table.

      f"ALTER TABLE {self.full_table_name} DELETE "
      f"WHERE {self.version_column_name} < {new_version}",
  ),

@gkarugi I see, yeah all records seem to have a _sdc_table_version of 0 initially 🤔. I'm not sure if that's a version that the tap emits in an ACTIVATE_VERSION message, or for some reason a default value that Clickhouse is inserting.
Some debugging steps that might be useful (might try them myself at a later time if this is isn't fixed:

Run meltano invoke tap-mysql > mysql.singer.jsonl with full-table replication for one table, and inspect the version values in ACTIVATE_VERSION messages.
Investigate whether clickhouse/clickhouse-sqlalchemy needs any special treatment for nullable columns.

Hi @edgarrmondragon
I debugged as per your suggestion and the first option(Run meltano invoke tap-mysql > mysql.singer.jsonl).
mysql.singer.jsonl had a pretty big output, so i have picket the top and bottom and merged them below.
You can find the full log here
{"type": "SCHEMA", "stream": "schema_db-model_has_platforms", "schema": {"properties": {"updated_at": {"inclusion": "available", "format": "date-time", "type": ["null", "string"]}, "id": {"inclusion": "automatic", "minimum": 0, "maximum":<PHONE_NUMBER>3709551615, "type": ["null", "integer"]}, "platformable_type": {"inclusion": "available", "maxLength": 191, "type": ["null", "string"]}, "platform_id": {"inclusion": "available", "minimum": 0, "maximum":<PHONE_NUMBER>3709551615, "type": ["null", "integer"]}, "platformable_id": {"inclusion": "available", "minimum": 0, "maximum":<PHONE_NUMBER>3709551615, "type": ["null", "integer"]}, "created_at": {"inclusion": "available", "format": "date-time", "type": ["null", "string"]}}, "type": "object"}, "key_properties": ["id"]}
{"type": "ACTIVATE_VERSION", "stream": "schema_db-model_has_platforms", "version":<PHONE_NUMBER>411}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 1, "platformable_type": "menu", "platform_id": 1, "platformable_id": 1, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 2, "platformable_type": "menu", "platform_id": 3, "platformable_id": 1, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 3, "platformable_type": "menu", "platform_id": 3, "platformable_id": 2, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 4, "platformable_type": "menu", "platform_id": 1, "platformable_id": 2, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 5, "platformable_type": "menu", "platform_id": 2, "platformable_id": 2, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 6, "platformable_type": "menu", "platform_id": 1, "platformable_id": 3, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 7, "platformable_type": "menu", "platform_id": 2, "platformable_id": 3, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 8, "platformable_type": "menu", "platform_id": 3, "platformable_id": 3, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 9, "platformable_type": "menu", "platform_id": 2, "platformable_id": 4, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 10, "platformable_type": "menu", "platform_id": 1, "platformable_id": 4, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 11, "platformable_type": "menu", "platform_id": 3, "platformable_id": 4, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 12, "platformable_type": "menu", "platform_id": 2, "platformable_id": 5, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 13, "platformable_type": "menu", "platform_id": 3, "platformable_id": 5, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 14, "platformable_type": "menu", "platform_id": 1, "platformable_id": 5, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 15, "platformable_type": "menu", "platform_id": 3, "platformable_id": 6, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 16, "platformable_type": "menu", "platform_id": 1, "platformable_id": 6, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 17, "platformable_type": "menu", "platform_id": 2, "platformable_id": 6, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 18, "platformable_type": "menu", "platform_id": 3, "platformable_id": 7, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 19, "platformable_type": "menu", "platform_id": 1, "platformable_id": 7, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 20, "platformable_type": "menu", "platform_id": 2, "platformable_id": 7, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 21, "platformable_type": "menu", "platform_id": 3, "platformable_id": 8, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 22, "platformable_type": "menu", "platform_id": 2, "platformable_id": 8, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:55+00:00", "id": 23, "platformable_type": "menu", "platform_id": 1, "platformable_id": 8, "created_at": "2021-07-21T08:37:55+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 24, "platformable_type": "menu", "platform_id": 1, "platformable_id": 9, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 25, "platformable_type": "menu", "platform_id": 2, "platformable_id": 9, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 26, "platformable_type": "menu", "platform_id": 2, "platformable_id": 10, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 27, "platformable_type": "menu", "platform_id": 2, "platformable_id": 11, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 28, "platformable_type": "menu", "platform_id": 1, "platformable_id": 11, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 29, "platformable_type": "menu", "platform_id": 2, "platformable_id": 12, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 30, "platformable_type": "menu", "platform_id": 3, "platformable_id": 12, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 31, "platformable_type": "menu", "platform_id": 1, "platformable_id": 12, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 32, "platformable_type": "menu", "platform_id": 1, "platformable_id": 13, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 33, "platformable_type": "menu", "platform_id": 1, "platformable_id": 14, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 34, "platformable_type": "menu", "platform_id": 1, "platformable_id": 15, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 35, "platformable_type": "menu", "platform_id": 3, "platformable_id": 15, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 36, "platformable_type": "menu", "platform_id": 2, "platformable_id": 15, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 37, "platformable_type": "menu", "platform_id": 1, "platformable_id": 16, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 38, "platformable_type": "menu", "platform_id": 3, "platformable_id": 16, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 39, "platformable_type": "menu", "platform_id": 1, "platformable_id": 17, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2021-07-21T08:37:56+00:00", "id": 40, "platformable_type": "menu", "platform_id": 2, "platformable_id": 17, "created_at": "2021-07-21T08:37:56+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:18:06+00:00", "id": 265271, "platformable_type": "banner_ad", "platform_id": 3, "platformable_id": 8, "created_at": "2022-08-03T12:18:06+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:19:04+00:00", "id": 265272, "platformable_type": "banner_ad", "platform_id": 1, "platformable_id": 9, "created_at": "2022-08-03T12:19:04+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:19:04+00:00", "id": 265273, "platformable_type": "banner_ad", "platform_id": 2, "platformable_id": 9, "created_at": "2022-08-03T12:19:04+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:19:04+00:00", "id": 265274, "platformable_type": "banner_ad", "platform_id": 3, "platformable_id": 9, "created_at": "2022-08-03T12:19:04+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:19:33+00:00", "id": 265275, "platformable_type": "banner_ad", "platform_id": 1, "platformable_id": 10, "created_at": "2022-08-03T12:19:33+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:19:33+00:00", "id": 265276, "platformable_type": "banner_ad", "platform_id": 2, "platformable_id": 10, "created_at": "2022-08-03T12:19:33+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-03T12:19:33+00:00", "id": 265277, "platformable_type": "banner_ad", "platform_id": 3, "platformable_id": 10, "created_at": "2022-08-03T12:19:33+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-23T14:20:41+00:00", "id": 265278, "platformable_type": "menu", "platform_id": 1, "platformable_id": 68, "created_at": "2022-08-23T14:20:41+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-23T14:20:41+00:00", "id": 265279, "platformable_type": "menu", "platform_id": 2, "platformable_id": 68, "created_at": "2022-08-23T14:20:41+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-23T14:20:41+00:00", "id": 265280, "platformable_type": "menu", "platform_id": 3, "platformable_id": 68, "created_at": "2022-08-23T14:20:41+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-08-23T14:20:51+00:00", "id": 265281, "platformable_type": "menu", "platform_id": 1, "platformable_id": 69, "created_at": "2022-08-23T14:20:51+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-09-15T07:44:05+00:00", "id": 265284, "platformable_type": "menu", "platform_id": 1, "platformable_id": 70, "created_at": "2022-09-15T07:44:05+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-09-15T07:44:05+00:00", "id": 265285, "platformable_type": "menu", "platform_id": 2, "platformable_id": 70, "created_at": "2022-09-15T07:44:05+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-09-15T07:44:05+00:00", "id": 265286, "platformable_type": "menu", "platform_id": 3, "platformable_id": 70, "created_at": "2022-09-15T07:44:05+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-11-09T06:37:23+00:00", "id": 265287, "platformable_type": "menu", "platform_id": 1, "platformable_id": 71, "created_at": "2022-11-09T06:37:23+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "RECORD", "stream": "schema_db-model_has_platforms", "record": {"updated_at": "2022-11-09T06:37:23+00:00", "id": 265288, "platformable_type": "menu", "platform_id": 1, "platformable_id": 72, "created_at": "2022-11-09T06:37:23+00:00"}, "version":<PHONE_NUMBER>411, "time_extracted": "2023-12-22T08:59:52.729220Z"}
{"type": "STATE", "value": {"currently_syncing": "schema_db-model_has_platforms", "bookmarks": {"schema_db-model_has_platforms": {"max_pk_values": {"id": 265288}, "last_pk_fetched": {"id": 265288}}}}}
{"type": "ACTIVATE_VERSION", "stream": "schema_db-model_has_platforms", "version":<PHONE_NUMBER>411}
{"type": "STATE", "value": {"currently_syncing": "schema_db-model_has_platforms", "bookmarks": {"schema_db-model_has_platforms": {"initial_full_table_complete": true}}}}
{"type": "STATE", "value": {"currently_syncing": null, "bookmarks": {"schema_db-model_has_platforms": {"initial_full_table_complete": true}}}}

Hi @edgarrmondragon any way I can assist with progressing this?

@gkarugi The hard_delete will be resolved in the next SDK release. As for the ACTIVATE_VERSION issue with target-clickhouse, I haven't had time to verify why the column is filled with 0s, but I suspect https://github.com/meltano/sdk/blob/c8e246133088e74f8600ed70e0e17058bf4578c4/singer_sdk/sinks/sql.py#L375-L379
is creating a column with a 0 value as default.


Update listActiveSelectionBackground color

Fixes #54735
During this week's ux sync we discussed the various options for a brighter color and decided to go with #0074E8 since it was the brightest without changing the hue. Let me know if this works.
Before

After

Side by side

cc @bpasero

This looks good to me, but I would have to try it out in practice to get a better opinon.
I will merge this in unless @joaomoreno and @bpasero have something to add

I saw it yesterday, seems fine to try out.

Yeah let's go crazy and merge it in, it is christmas after all!


Pitch video

Potential script

https://drive.google.com/file/d/1wQV78vlOI2OFkg9rH06Yx5ZvJZYGlwo7/view?usp=sharing

video submitted for capstone competition


Create contact's info block

Links to social networks (Facebook or Instagram, etc.), phone number or email address, etc. Maybe not all the links in the world, but only those that are really relevant.

Linkedin
Instagram
Facebook


fix: expose options only on web preset

Hi, I'm submitting a small fix so that the plugin options are only visible for Web presets.

Thanks!


Drop support for Python 2

As discussed in the comments of #4.

Coverage remained the same at 100.0% when pulling aa5e40ed8955cadb6a91d795eac08abed19edec9 on py3 into 862fce058ba186ee53a2629aff98573e76678a57 on master.

Coverage remained the same at 100.0% when pulling aa5e40ed8955cadb6a91d795eac08abed19edec9 on py3 into 862fce058ba186ee53a2629aff98573e76678a57 on master.

Coverage remained the same at 100.0% when pulling 47e16d463287ae3d06f2a6b418e669bf97f56a1e on py3 into 862fce058ba186ee53a2629aff98573e76678a57 on master.


standardize.exploratories()

function to resolve a locationID based on Biodiversities EPPlotID. matches provided ID against lookup table and fills in longitude and latitude.

5d4cd0abd77ade2280fc951500265182a2884f4d
Functional. The function extracts location descriptors from BExIS datasets and matches them against the provided locationID. works only for format HEW9, AEG10 etc. No fuzzy matching or Grid plot ID matching until now.


[Bug] Ctrl+click opens the note to a new tab, causing it to flash continuously

https://github.com/czottmann/obsidian-mononote/issues/19
https://github.com/czottmann/obsidian-mononote/issues/21
Reproducible:

Open note via File Explorer
⌘-click another note in File Explorer
Endless looping!

@doit132 Thanks for the report, looks like the same issue as #19. I'll look into it during the next few days!

Fixed in Release 1.2.1. Re-open the ticket if it isn't, please!


ha snapshot new timeouts and returns code 1

Describe the problem
ha snapshot new:

issues a timeout message after 30 seconds
then terminates with return code 1 (error)
at this time, snapshot creation has not ended yet

The issue happened for the first time on today 2.30am CEST. It has never happened before while the scripts runs daily for several months.
Debug information

SSH Addon type

[X] Community
[ ] Core
[ ] Custom

Version of the CLI

$ ha cli info
update_available: false
version: 2021.04.1
version_latest: 2021.04.1

Version of Home Assistant Core & the Home Assistant Supervisor

Home Assistant OS: 5.13
Home Assistant Core: 2021.4.6
Home Assistant Supervisor: 2021.04.0

Output from executing the command with debug info

date ; ha snapshot new --no-progress --log-level debug ; echo $?; date
Sat May  1 19:28:13 CEST 2021
DEBU[0000] Adding homedir to searchpath                  homedir=/root
INFO[0000] No configfile found
DEBU[0000] Debug flags                                   apiToken=50e46323xxxxxx8b94c076675bb3dc7d193cc2ca6e1c335cba8c1 cfgFile= endpoint=supervisor logLevel=debug noProgress=true rawJSON=false
DEBU[0000] snapshots new                                 args="[]"
DEBU[0000] addons                                        addons="[]"
DEBU[0000] folders                                       folders="[]"
DEBU[0000] [GenerateURI]                                 base=supervisor command=new/full section=snapshots
DEBU[0000] [GenerateURI] Result                          uri="http://supervisor/snapshots/new/full" url="http://supervisor/snapshots/new/full" url(string)="http://supervisor/snapshots/new/full"
Post "http://supervisor/snapshots/new/full": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
1
Sat May  1 19:28:43 CEST 2021

Expected behavior
ha snapshot new should:

terminate after snaphshot is fully created
without timeout message
with return code 0

...to allow correct execution of backup scripts
Additional context
Anything related to Pull Request #290 ?

I am having this issue in my addon as well

I can also confirm this issue.  The script fails due the timeout issue of the CLI command.
Could we provide more information to help debugging this issue?

This is solved by #296.


Sound design - Produce assets

Produced:

ambience (sewer)  --> draft committed (sewer_ambience_mixdown) -> also covers environmental sounds
environment (sewer)  --> currently ambience covers this --> can be separate assets based on request
enemy unit (presence)

fly  --> draft committed (enemy_unit_fly)
cockroach  --> draft committed (enemy_unit_cockroach)
rat  --> draft committed (enemy_unit_rat)
player unit sebződés  --> draft committed (enemy_unit_attack)

Player unit

footsteps  --> draft committed (footsteps_basic)
kaki gyűjtés (upgrade)  --> draft committed (kaki_upgrade)
kaki vesztés (downgrade)  --> draft committed (kaki_downgrade)
item felszedése  --> draft committed (item_pickup)
step on glass  --> draft committed (player_step_on_glass)
walk in green trutyi  --> draft committed (player_step_in_sewage_water)
interact w/ old phone   --> draft committed (player_interact_old_phone)

Menu

hover over button  --> draft committed (menu_button_hover)
click button  --> draft committed (menu_button_click)
in-game menu pop-up (kaki bubbles)  --> draft committed (menu_ingame_popup)

Gameplay

win condition - end game (nature waterfall + heavenly choir, harp)  --> draft committed (endgame_victory_sound_...)
win condition after map (toilet flush sound)  --> draft committed (win_sound_flush)
defeat condition after map (splat sound)  --> draft committed (defeat_sound_splat)

To be produced:

Player unit

interact w/ old computer  --> to be produced (Attila)

Menu

menu music --> to be produced (Balázs)

Gameplay

gameplay music  --> to be produced (Balázs)

other characters

voiceovers for story  --> to be produced (Attila)

Additional:
- audio mastering based on overall sound quality during gameplay test

ha kész a #156 akkor szerintem megcsinálom ezt is

closes #99


Update repo structure

With this PR I would like to propose a change in the repository structure while addressing https://github.com/robotology/urdf2casadi-matlab/pull/6#pullrequestreview-535179915.

@isorrentino


Re-enable Capistrano 3 support

It seems that cap3 support was disabled after 1.5.0:
https://github.com/rvm/rvm-capistrano/commit/431170436402a0e27abb35003d3ae58dd5d8152b
cap3 has been released for quite a while now and 1.5.0 works perfectly with it
the support should be re-enabled in gemspec

capistrano3 is not compatible with capistrano2 - please use https://github.com/rvm/rvm1-capistrano3 instead


ci(airflow): Pin apache-airflow version

Description

Fix #295 failing end to end tests for kedro-airflow
Development notes

There was a new release for apache-airflow on 18th August 2023 which broke something with sqlalchemy
What do we think about setting version for apache-airflow to <2.7.0 for now?
Checklist

[ ] Opened this PR as a 'Draft Pull Request' if it is work-in-progress
[ ] Updated the documentation to reflect the code changes
[ ] Added a description of this change in the relevant RELEASE.md file
[ ] Added tests to cover my changes

The also dropped support for Python 3.7 btw 👀

Thanks @ankatiyar !