Building master branch failed, error [E0425]

Bug Report

What version of TiKV are you using?

master branch : a757f69
What operating system and CPU are you using?

ProductName:	Mac OS X
ProductVersion:	10.14.5
BuildVersion:	18F2059
Darwin 18.6.0 Darwin Kernel Version 18.6.0: Sun Apr 28 18:06:45 PDT 2019; root:xnu-4903.261.4~6/RELEASE_X86_64 x86_64
Steps to reproduce

git clone https://github.com/tikv/tikv.git
cd tikv
make
What did you expect?
Successfully build tikv
What did happened?
Compiling pd_client v0.1.0 (/Users/damn/go/src/github.com/pingcap/tikv/components/pd_client)
warning: the feature `ptr_offset_from` has been stable since 1.47.0 and no longer requires an attribute to enable
  --> components/tidb_query_datatype/src/lib.rs:10:12
   |
10 | #![feature(ptr_offset_from)]
   |            ^^^^^^^^^^^^^^^
   |
   = note: `#[warn(stable_features)]` on by default

   Compiling tidb_query_shared_expr v0.0.1 (/Users/damn/go/src/github.com/pingcap/tikv/components/tidb_query_shared_expr)
   Compiling tidb_query_vec_expr v0.0.1 (/Users/damn/go/src/github.com/pingcap/tikv/components/tidb_query_vec_expr)
error[E0425]: cannot find value `val` in this scope
   --> components/tidb_query_vec_expr/src/impl_cast.rs:979:5
    |
979 |     val.into_inner().to_string().as_bytes()
    |     ^^^ not found in this scope

error[E0425]: cannot find value `val` in this scope
   --> components/tidb_query_vec_expr/src/impl_cast.rs:981:53
    |
981 | cast_as_duration!(BytesRef, cast_bytes_as_duration, val);
    |                                                     ^^^ not found in this scope

error[E0425]: cannot find value `val` in this scope
   --> components/tidb_query_vec_expr/src/impl_cast.rs:985:5
    |
985 |     val.to_string().as_bytes()
    |     ^^^ not found in this scope

error[E0425]: cannot find value `val` in this scope
   --> components/tidb_query_vec_expr/src/impl_cast.rs:987:51
    |
987 | cast_as_duration!(JsonRef, cast_json_as_duration, val.unquote()?.as_bytes());
    |                                                   ^^^ not found in this scope

   Compiling tidb_query_normal_expr v0.0.1 (/Users/damn/go/src/github.com/pingcap/tikv/components/tidb_query_normal_expr)
error: aborting due to 4 previous errors

For more information about this error, try `rustc --explain E0425`.
error: could not compile `tidb_query_vec_expr`.

To learn more, run the command again with --verbose.
warning: build failed, waiting for other jobs to finish...
warning: 1 warning emitted

    Building [====================================================>  ] 575/587

/label component/build

/label status/waiting

/label sig/tools

Sorry for so late reply, please use make release to build tikv.

Sorry for so late reply, does this issue still exist?

after pulling newest master and make release, following error raised:
make release
cargo build --release --no-default-features --features " jemalloc sse protobuf-codec test-engines-rocksdb"
   Compiling grpcio-sys v0.7.2
   Compiling librocksdb_sys v0.1.0 (https://github.com/tikv/rust-rocksdb.git#954c2a47)
   Compiling file_system v0.1.0 (/Users/damn/go/src/github.com/pingcap/tikv/components/file_system)
error[E0658]: use of unstable library feature 'future_readiness_fns'
  --> components/file_system/src/rate_limiter.rs:35:9
   |
35 |         future::ready(self.request(io_type, io_op, bytes))
   |         ^^^^^^^^^^^^^
   |
   = note: see issue #70921 <https://github.com/rust-lang/rust/issues/70921> for more information
   = help: add `#![feature(future_readiness_fns)]` to the crate attributes to enable

   Compiling rocksdb v0.3.0 (https://github.com/tikv/rust-rocksdb.git#954c2a47)
error: aborting due to previous error

For more information about this error, try `rustc --explain E0658`.
error: could not compile `file_system`.

To learn more, run the command again with --verbose.
warning: build failed, waiting for other jobs to finish...
error: build failed
make: *** [release] Error 101


Change docs to use non-macro names for Nom 5+.

Nom's implementation now relies on functions internally vs. using macros before.
Many of the docs still use the old macro names, which is the non-idiomatic way to use Nom as of the time of writing. This can create an impediment for users (like me -- I just spent a large amount of time trying to self-start after the version bump).
I am filing this issue to so that Nom contributors can discuss this.

could you point at which docs require an update?

This one: choosing_a_combinator.md. Column «usage» and a text below the tables.

Possibly this needs to be updated?
https://github.com/Geal/nom/blob/master/doc/choosing_a_combinator.md

Duplicate of #1140 ?
I started to restructure the list but never got any feedback, so I never finished the page. But if you like the structure I could continue the work: https://github.com/ottosson/nom/blob/master/doc/choosing_a_combinator.md (only the first table is updated at the moment).


Remove re-configure after updating stream meta

Minimize audio tracks table height (currently too much empty space)
Do not re-configure stream after updating audio stream metadata

Relates to #34


Any updates planned?

Dear @takeshinoda,
Thanks for this great gem.
I would like to know if you plan to update this gem as 'thinreports' and other gems have updated versions (prawl, etc.)?
Thanks.

Now, release 0.2.0.
https://rubygems.org/gems/thinreports-rails/versions/0.2.0

Thank you very much.
Regards.


DCOS-48057 - Disable Jenkins build that runs on Hamburg Macbook that will never run.

Hey @jbarrick-mesosphere , @cgawron1 , the issue is now resolved and the agent is back online.
Please revert this change 👍


Update community link with current URL

The original link was a "placeholder"—I have updated the README with the correct community link.
Also fixed a spelling error.

Fixed d166e7bcbeec145a09d606e96edc9b49f13a05ce


add greenkeeper-lock config

Coverage remained the same at 81.539% when pulling 605e6d1a79abe9501621a9ea8f286c4126cb43d9 on feature/greenkeeper-lockfile into ab8f9fb8cd73329f0213ada9cda1dea11205ba0c on develop.

Coverage remained the same at 81.539% when pulling 36527bf5d94622d79177a9083d05d744cc960673 on feature/greenkeeper-lockfile into aaab0c0c46f650af9c1f64337fbd2c4a01c698f4 on develop.


[BUG] [Segment Replication] NO-OP recovery not attempted

Describe the bug
Coming from https://github.com/opensearch-project/OpenSearch/issues/6761 exercise, few tests are flaky because NO-OP recovery is not performed.
Background
Cluster manager today relies on ReplicaShardAllocator for replica shards recoveries (other than newly created indices), where it pings all nodes for their store metadata. Cluster manager then selects a node and identify the feasibility to perform no-op recovery. If it is posible, cluster-manager cancels the ongoing recovery. A no-op recovery is identified when the target satisfies either of below two conditions

Retaining sequence no >= primary's retaining seq no
Both primary and target node has same sync_id (marker which is updated for inactive (no indexing for 5 mins) shard copies & persisted on disk)

To Reproduce
Below integration tests fails reliably

CloseIndexIT.testNoopPeerRecoveriesWhenIndexClosed
ReplicaShardAllocatorIT.testFullClusterRestartPerformNoopRecovery

** Impact **
During node restart, replica recovery will perform a full file based recovery.
Expected behavior
No-op recovery should be performed when it is applicable

Similar to https://github.com/opensearch-project/OpenSearch/issues/7163#issuecomment-1716627640 this test expects sequence number of recovery to go through. Closing this issue as this is expected behavior with segment replication.


Issues (reading registry and other stuff) after impersonation (using NTLM)

Hello,
I have tried nsspi, and it's a very nice component.
However I'm having issues after impersonation:

with special folders (MyDocuments)
trying to read registry.
The existing code which writes a file does not work either.

The server is running under a user profile (Someuser2) which:

is part of the Users group.
has the "Impersonate a Client AfterAuthentication" User Right (SeImpersonatePrivilege).
I suppose the problem is with Someuser2.
I hope you can point me to the right direction...

The client is running under another profile.
The tests are performed in the same workgroup (no domain), and the problem occurs when the client and the server run on the same machine (Win 8.1) or on 2 different machines (server=Win8.1,client=Win2016).
Some stuff works, but:

I have added serveral lines of code in ServerForm.impersonateButton_Click() to read the registry and it does not work (exceptions thrown).

The code which is is originally in ServerForm.impersonateButton_Click() to write a file does not work anymore either.

Of course I did not change anything else in the code.
  private void impersonateButton_Click(object sender, EventArgs e)
  {
  	ImpersonationHandle handle;

  	// Get the MyDocuments folder before impersonation: WORKS.
  	Console.WriteLine("MyDoc BEFORE impersonation=" + Environment.GetFolderPath(Environment.SpecialFolder.MyDocuments));

  	using (handle = this.serverContext.ImpersonateClient())
  	{
  		// Get the current UserName AFTER impersonation: WORKS.

Source=mscorlib
StackTrace:
at System.Diagnostics.Tracing.EventProvider.Register(Guid providerGuid)
InnerException:
(1346 is Either a required impersonation level was not provided, or the provided impersonation level is invalid.)
System.Security.SecurityException occurred
HResult=-2146233078
Message=Requested registry access is not allowed.
Source=mscorlib
StackTrace:
at System.ThrowHelper.ThrowSecurityException(ExceptionResource resource)
InnerException:
(-2146233078 = 0x8013150A = COR_E_SECURITY)
Here are the details in the console:
TestServer
Server: Received ClientToken
Server: Sent ServerToken
Server: Received ClientToken
Server: Sent ServerToken
MyDoc BEFORE impersonation=C:\Users\Someuser2\Documents
Starting impersonation: ggo
MyDoc AFTER impersonation=
GetVal
*** REGISTRY access ***
EX: System.Security.SecurityException: Requested registry access is not allowed.
at System.ThrowHelper.ThrowSecurityException(ExceptionResource resource)
at Microsoft.Win32.RegistryKey.OpenSubKey(String name, Boolean writable)
at Microsoft.Win32.Registry.GetValue(String keyName, String valueName, Object
defaultValue)
at TestServer.ServerForm.impersonateButton_Click(Object sender, EventArgs e)
The Zone of the assembly that failed was:
MyComputer
System.Security.SecurityException
at System.ThrowHelper.ThrowSecurityException(ExceptionResource resource)
at Microsoft.Win32.RegistryKey.OpenSubKey(String name, Boolean writable)
at Microsoft.Win32.Registry.GetValue(String keyName, String valueName, Object
defaultValue)
at TestServer.ServerForm.impersonateButton_Click(Object sender, EventArgs e)
*** File creation access ***
EX2: System.IO.IOException: Unknown error "1346".
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, I
nt32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions o
ptions, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolea
n useLongPath, Boolean checkHost)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access,
FileShare share, Int32 bufferSize)
at System.IO.File.Create(String path)
at TestServer.ServerForm.impersonateButton_Click(Object sender, EventArgs e)
System.IO.IOException
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, I
nt32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions o
ptions, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolea
n useLongPath, Boolean checkHost)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access,
FileShare share, Int32 bufferSize)
at System.IO.File.Create(String path)
at TestServer.ServerForm.impersonateButton_Click(Object sender, EventArgs e)
Thank you very much,
best regards,
Olivier gg.

I believe that you need 'Act as part of operating system' privilege too. Give this permission too and check it again.

Thank you for the suggestion.
Unfortunately it didn't help. I have even restarted the system just in case, but it's still not working.
I have noticed that it works when I run the server example as SYSTEM, but I still can't figure out which permission is missing for Someuser2...

Is it working if the Someuser2 member of the 'Administrators' group?
Try to give the 'Create global objects' privileges too and try it again.

It didn't work with the 'Create global objects' privilege,
but adding Someuser2 to the  'Administrators' group did work!
Thank you.
I guess I have to figure out what are the user rights differences between the 'Administrators' group and the regular 'Users' group regarding impersonation...
Thank again.


failing to execute "rosdep install" command mentioned in step-3 without  errors.

Hi
I was trying to build the UR ROS2 driver while executing the command mentioned in step -3 i.e.
rosdep install --ignore-src --from-paths src -y -r
it fails with following error:

ERROR: the following packages/stacks could not have their rosdep keys resolved
to system dependencies:
joint_trajectory_controller: No definition of [realtime_tools] for OS version [bionic]
diff_drive_controller: No definition of [realtime_tools] for OS version [bionic]
forward_command_controller: No definition of [realtime_tools] for OS version [bionic]
ros2_control_demo_robot: No definition of [joint_state_publisher_gui] for OS version [bionic]
ur_description: No definition of [xacro] for OS version [bionic]
ur_bringup: No definition of [xacro] for OS version [bionic]
ur_controllers: No definition of [realtime_tools] for OS version [bionic]
Continuing to install resolvable dependencies...
#All required rosdeps installed successfully

ROS2 setting looks as below

$ printenv | grep ROS
ROS_VERSION=2
ROS_LOCALHOST_ONLY=0
ROS_PYTHON_VERSION=3
ROS_DISTRO=foxy

Is it that it cant be compiled for target ubutnu version 18.04. (bionic). Or Am I missing to execute/source some configurational settings ?
Thanks
Das

Thanks for the response. I will move my host OS to 20.04 to restrain from any further compatibility issues. Kindly close the issue.


Adding Non-Maximum Suppression (NMS) utility to fiftyone.utils.labels through perform_nms()

What changes are proposed in this pull request?
Adds Non-Maximum Suppression (NMS) utility to fiftyone.utils.labels through perform_nms()! :tada:
It can be loaded as follows:
import fiftyone.utils.labels as fl

dataset = foz.load_zoo_dataset(
    "coco-2017",
    split="validation",
    dataset_name="detector-recipe",
)

predictions_view = dataset.take(10, seed=51)

fl.perform_nms(sample_collection=predictions_view, in_field="predictions", out_field="nms_predictions", conf_threshold=0.65, iou_threshold=0.4, progress=True)

How is this patch tested? If it is not, please explain why.
It has been thoroughly tested, as seen in this nms_test.pdf
Release Notes
Is this a user-facing change that should be mentioned in the release notes?

[ ] No. You can skip the rest of this section.
[x] Yes. Give a description of this change to be included in the release
notes for FiftyOne users.

Addition of perform_nms() utility to fiftyone.utils.labels
What areas of FiftyOne does this PR affect?

[ ] App: FiftyOne application changes
[ ] Build: Build and test infrastructure changes
[x] Core: Core fiftyone Python library changes
[x] Documentation: FiftyOne documentation changes
[ ] Other

@rohis06 overall the method looks great, just have a few suggestions on implementation that would clean things up a bit if you're open to them! 😄

Thanks a lot for reviewing this, @brimoor. I really appreciate your feedback! 😄
I'm definitely open to suggestions, and I'll incorporate them to clean things up.

@rohis06 overall the method looks great, just have a few suggestions on implementation that would clean things up a bit if you're open to them! 😄

Thanks a lot for reviewing this, @brimoor. I really appreciate your feedback! 😄 I'm definitely open to suggestions, and I'll incorporate them to clean things up.

@brimoor, I have addressed the review comments.
Could you let me know if this clears things up? 😄

@rohis06 thanks for your contribution! 🎉

Anytime! 😄


Release messages not getting posted to PRs merged to beta when beta is merged to master

Not sure if this can be resolved with how our semantic-release workflow functions

This seems to be working fine now


Pre auction module out of date

Bidders are instructed to look for ad slot in fpd instead of ortb2.
@caitlinwright123 @bretg fyi

fixed in #2835


changed directory permissions for .rekor directory

Changed the permissions for .rekor directory because they were too restrictive to allow new writes

Nice! This was causing issues saving state for fresh installs.

750 would get this past gate.


UnitTests in Java sources

Hello,
I have a question - why are you putting Unit Tests in Java Source like in: https://github.com/Netflix/zuul/blob/1.x/zuul-core/src/main/java/com/netflix/zuul/FilterFileManager.java
It is a common pattern in repository. What are a reasons behind this decision? Pros, Cons?
Maybe it shouldn't be in Issue section but you really made me curious about that :)

It looks like the group just rejected a PR that was attempting to move the tests out of the source code. #220 The reasoning from @mikeycohen was "This keeps logic and testing close."
My team's implementation of zuul has our tests separated from the source files as our own style preference (I am not at Netflix so this is a completely independent opinion).

Thanks for reply. Taste or style of coding is valid argument.


OOP_School_Library

Refactor code
The following changes introduced:

Make sure YAGNI, KISS, and DRY rules and Ruby style guide are respected.
Follow SOLID principles.
Check each class for Single-responsibility Principle
Add some changes in the main to include the Single-responsibility Principle

@Whoistolu Hi, hopefully, be fine.
if you check other commits they are for other branches and this branch just has a few commits.
just this 3 one is this branch commit
@AhmadiGu
Refactor the code
8bed5ac
@Ibtisam34
modified readme
13d7f0f
@AhmadiGu
Linters fixed

@Whoistolu Hi, hopefully, be fine. if you check other commits they are for other branches and this branch just has a few commits. just this 3 one is this branch commit @AhmadiGu Refactor the code 8bed5ac @Ibtisam34 modified readme 13d7f0f @AhmadiGu Linters fixed

Thank you for the clarification @AhmadiGu.
Kindly ask for another review.


soname changed in a micro release

@hobu I only noticed this now due to https://github.com/conda-forge/qgis-feedstock/issues/92 bit 1.9.1 should've been 1.10.0 instead if we are trying to follow semver.

I must have bumped the soname incorrectly. We should maybe issue a 1.9.4 then.

Next big libspatialindex release will be 2.0.

:heart:

❤

it might be in 5 years 😛


Corrects the noarch entry points by adding them to the recipe

Checklist

[ ] Used a fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The recipe license should not include the word "License".

For recipe:

Whenever possible python packages should use pip. See https://conda-forge.org/docs/meta.html#use-pip

@conda-forge-admin, please rerender

Looks good to me, thanks for the fix!
Fixes #4 .


Remove index locking

AWS managed elasticsearch doesn't support index locking, so search-api
shouldn't pretend it can do it.  Index locking is used in two places:

schema migrations
bulk loading page traffic data

Both of these tasks involve migrating data to a new index, so by
disabling locking we open the possibility of the old index receiving
updates which the new index misses out on.  With index locking, such
changes would simple be discarded.
I don't think that's a problem:

updates dropped due to a locked index in schema migrations need to
be recovered anyway (via whitehall traffic replay or publishing api
shenanigans), so changing the way in which updates are lost doesn't
matter.

the page traffic index is only updated by this one script, which is
run daily by jenkins, so unless it takes over 24 hours to run
there's no chance of a clash.

Trello card

There is a problem with this approach: if the new index is malformed (eg, it's missing documents because ES has been blocking writes due to you being silly and exhausting your AWS quota by not deleting old indices), then this branch switches to it - even if it's tens of thousands of documents behind.


Disable support for DSA sign and key gen by default in the FIPS provider.

FIPS 140-3 now uses FIPS 186-5 which removes DSA.
DSA may still be used for Verification for legacy purposes.

Checklist

[x] documentation is added or updated
[x] tests are added or updated

Added as a Draft since this will need to apply to OpenSSL 3.4.0 (Currently the tests test against 3.3.0).

Closing this, replacing with https://github.com/openssl/openssl/pull/24799


Moving to Go as target/auxiliar language for Dafny?

Until now we were using Java as a target and auxiliar language for Dafny, but we don't have much Java expertise in the group and we already found trouble with memory usage. In practice we could move to Go and Python. Python might be slow and sounds dangerous, so we decided for Go.
The current auxiliary stuff we have is JVM-oriented (Java lang, Gradle build system), so we'd have to migrate those.
However, that auxiliary stuff is currently mostly involved with dealing with part of the Ethereum Common tests, and right now we're about to implement the t8n interface, so with some luck we might be able to deprecate (most of?) that Java code instead of migrating it.

More generally, we should implement as much as possible in Dafny (even if unverified), since that code will get auto-translated to the target language.
And that opens up the door to extending the verified part as we go :)


Add TapticEngine

Project URL
https://github.com/WorldDownTown/TapticEngine
Description

TapticEngine generates iOS Device vibrations.
This library wrapps on UIImpactFeedbackGenerator, UISelectionFeedbackGenerator, UINotificationFeedbackGenerator.
Why it should be included to awesome-ios (optional)
The library using UIFeedbackGenerator is very rare, and TapticEngine is easier to generate a device vibration than UIFeedbackGenerator.
Checklist

[x] Only one project/change is in this pull request
[x] Addition in chronological order (bottom of category)
[x] Supports iOS 9 / tvOS 10 or later
[x] Supports Swift 3
[x] Has a commit from less than 2 years ago
[x] Has a clear README in English

Nice wrapper! Thank you for contributing! :tada:


feat: Add IsParseErr helper(issue 559)

add the global variable call ErrParse and set it to the struct of RedisMessage as function IsParseErr and add some judgment condition in some toXX() type method in PR555

by the way, sorry about the title, I remember the wrong issue I working with Q A Q

by the way, sorry about the title, I remember the wrong issue I working with Q A Q

No worry. Please also write a test for the IsParseErr.

by the way, sorry about the title, I remember the wrong issue I working with Q A Q

No worry. Please also write a test for the IsParseErr.

Ok, I will wrote it

Merged. Thank you for your contributions @LWF15!


Correction for raw affiliation Provost, De Montfort University Dubai, United Arab Emirates

Correction needed for raw affiliation Provost, De Montfort University Dubai, United Arab Emirates
raw_affiliation_name: Provost, De Montfort University Dubai, United Arab Emirates
new_rors: 0312pnr83
previous_rors:
works_examples: W4281914511
contact: 09c65e305d9c1fab2f3877d70829022d:302ac8 @ dmu.ac.uk

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.


"Do the right thing" when adding multipolygon relations

have two areas (ways), with tags, and one of them enclosed in the other.
create a multipolygon
add the ways as outer/inner

Results:
an relation with no tags other than "type=multipolygon"
Expected results:
The tags on the outer way should be moved to the multipolygon.
Note there might be other "Expected results", and there might be better ways to do this in the interface. But creating empty multipolygons can not be a good idea. IMHO.

We already do move the tags from the outer way to the multipolygon relation if you use the Merge operation.  See below:

But I guess we could also handle the situation where a user wants to manually create a multipolygon and specify the inner and outer ways.  We'd just need to add a special case to do the same things the merge operation does when the role is set to "outer".

I think this use case is properly addressed with the merge operation, and iD should not do anything special if you add relation members with the raw relation editor.


Compression Circuit: snark-verifier-ce

move compression circuit into package separate from aggregation circuit.
use existing aggregation circuit in community edition snark-verifier for compression circuit.
use Param type for Circuit trait.

add some high level comments for this project. like why we need 2 version of snark-verifier.

testing e2e in scroll-prover

testing e2e in scroll-prover
scroll-tech/scroll-prover#340
failed.. log location: /home/ubuntu/zzhang/scroll-prover/integration/outputs/e2e_tests_20240905_065015/log.txt at super2. run with make test-e2e-prove
the log said in batch circuit constuction, the pre-check (pairing check of layer2 compression proof) is valid. Not sure whether we do a similar pre-check (check pairing of accumulator) in CompressionCircuit (we should). Anyway, the 2 versions of snark-verifier may not work well with each other in interleaving construction.
super(old) -> layer1(new) -> layer2(new) -> batch(old) -> layer4(new) -> recusion(old) -> layer6(new)
will run make test-chunk-prove. Oh even make test-chunk-prove passes, it does not mean everything is good.. We need to add accumulator pairing check (1) during CompressCircuit constrcution (2) inside ChunkVerifier

Accumulator pairing pre-checks added for CompressionCircuit construction and verify_chunk_proof

@lispc Accumulator pairing pre-checks added for CompressionCircuit construction and verify_chunk_proof in latest commits

@lispc Accumulator pairing pre-checks added for CompressionCircuit construction and verify_chunk_proof in latest commits

great, i will re-run make test-chunk-prove today

oh i noticed the CI time is much longer..   Did we add some huge tests in this PR?

oh i noticed the CI time is much longer.. Did we add some huge tests in this PR?

There is a new test named test_to_ce_snark here:
https://github.com/scroll-tech/zkevm-circuits/pull/1377/files#diff-df874cf5d2d2665f51cc7befc2d39ddeea2961ec857c8a3e4ab78ad7513e569dR97-R107

testing

testing chunk proving


update ru locale

Updated ru locale

Coverage decreased (-0.04%) to 70.892% when pulling aab4d628155d152d0d712319fb52a740417d5d48 on chexex:update_ru_locale into df86208bb837f8c937f639edc7d68dca4e4d0d7f on django-extensions:master.

Coverage decreased (-0.04%) to 70.892% when pulling aab4d628155d152d0d712319fb52a740417d5d48 on chexex:update_ru_locale into df86208bb837f8c937f639edc7d68dca4e4d0d7f on django-extensions:master.

Coverage decreased (-0.04%) to 70.892% when pulling aab4d628155d152d0d712319fb52a740417d5d48 on chexex:update_ru_locale into df86208bb837f8c937f639edc7d68dca4e4d0d7f on django-extensions:master.

Coverage decreased (-0.04%) to 70.892% when pulling aab4d628155d152d0d712319fb52a740417d5d48 on chexex:update_ru_locale into df86208bb837f8c937f639edc7d68dca4e4d0d7f on django-extensions:master.

Thanks !


[HOLD for payment 2024-11-22] Integrate convert.com to new.expensify.com (web only)

Tracking issue to integrate Convert.com to New.expensify.com (web only)
https://support.convert.com/hc/en-us/articles/205151015-how-to-install-the-main-tag-convert-tracking-code-javascript-#s3
Issue OwnerCurrent Issue Owner: @JmillsExpensify

Just a payment summary required here, and it can't be by me, so I'll pull someone else in for that part.

Payment summary:

Reviewer: @allroundexperts owed $250 via NewDot

Please submit via NewDot, thanks!


git_commit - continue execution if there is nothing to commit

Question Checklist

[x] Updated fastlane to the latest version
[x] I read the Contribution Guidelines
[x] I read docs.fastlane.tools
[x] I searched for existing GitHub issues

Question Subject

git_commit action
Question Description

I use the git_commit action:

git_commit(path: "*", message: "message")

This action fails if there is nothing to commit. How can I continue executing my Fastlane script even if there is nothing to commit?
What I'm looking for could be accomplished with the any of the two options:

Add some parameter to the git_commit action so it would not crash the script if there is nothing to commit (but rather, continue)
Check if there are any changes and only then invoke git_commit.

I didn't find any way to get this done using method 1, so I'm looking for an implementation with the second approach.
Also, is it possible to add any flag to continue execution, or use a similar action:
git_commit_if_needed.....

How does it "fail" or "crash the script"? Please post the output you are currently getting. Thanks.

👋 @richardtop @janpio
I did a quick test:

I think adding new parameter to git_commit action like skip_when_nothing_to_commit can be helpful.
Please tell me what you think about the name of suggested param and of course share your ideas 🙇
If we agree on the solution, I will be happy to implement it 🤚

Hi @mollyIV, your proposed solution looks great. Thanks a lot!

Agree with @richardtop. Might be worth going through other existing actions though if there are similar options in other actions so we can use consistent naming. (I am not aware of any, but I also don't really know many action params)

Here we go guys https://github.com/fastlane/fastlane/pull/14501 🎁


Update travis with install script, and caching

:godmode: - > not sure how much this will speed up travis, but hopefully no harm in trying!


How to format a multi-line config?

Checklist

[x] I'm asking a question
[x] I've looked through the README and FAQ for similar questions
[x] I've searched the bugtracker for similar questions including closed ones

Question
What is the format of the config file? I'm using the following config:
--format bestvideo[vcodec!*=av01]+bestaudio\
/best[vcodec!*=av01]\
/best
--add-metadata

I'm not sure about how to format the --format option. Should the whole thing be quoted? Should there be \ at the end of each line?

Either way works.


Typedef exceptions can occur when utilizing vehicle data getter methods that return Doubles

Currently this is an issue for getVehicleData and SubscribeVehicleData rpc's.
When receiving float based values from sdl core that do not include a decimal (e.g. 80) internal objects are stored as integers causing casting exceptions to occur when values are returned via rpc getter methods (e.g. getSpeed).

I don't think this is an issue with the Android libraries, this is an issue with versions of SDL core not meeting the specification, but yeah, the Android libs need to support this incorrect behavior from SDL core.  An issue should be filed for SDL core as well, unless this has been fixed core-side already.
I think this needs to be maintained as part of a list of "hacks" required to support backwards compatibility issues.


"Dereferencing a URL did not result in a valid JSON-LD context"  for all given examples

package main

import (
	"github.com/piprate/json-gold/ld"
	"log"
)

func main() {
	proc := ld.NewJsonLdProcessor()
	options := ld.NewJsonLdOptions("")

	// expanding remote document

	expanded, err := proc.Expand("http://json-ld.org/test-suite/tests/expand-0002-in.jsonld", options)
	if err != nil {
		log.Println("Error when expanding JSON-LD document:", err)
		return
	}

	ld.PrintDocument("JSON-LD expansion succeeded", expanded)

	// expanding in-memory document

	doc := map[string]interface{}{
		"@context":  "https://schema.org/Person",
		"@type":     "Person",
		"name":      "Jane Doe",
		"jobTitle":  "Professor",
		"telephone": "(425) 123-4567",
		"url":       "http://www.janedoe.com",
	}

	expanded, err = proc.Expand(doc, options)
	if err != nil {
		panic(err)
	}

	ld.PrintDocument("JSON-LD expansion succeeded", expanded)
}

panic: loading remote context failed: Dereferencing a URL did not result in a valid JSON-LD context: https://schema.org/Person
goroutine 1 [running]:
main.main()
/Users/denislamotte/Desktop/work/jsonld/jsonld.go:35 +0x578
exit status 2

@lanfeust21, either "http://schema.org" or "https://schema.org" are correct contexts for schema.org. "https://schema.org/Person" is not (it's a type). Please refer to schema.org for valid examples of JSON-LD for Person.

Maybe but it's the example given by the code i did not change anything.
The change change nothing and still create the same error

@lanfeust21 can you please provide a link to the example that uses
"@context":  "https://schema.org/Person",

?
You reported that the proposed changes don't work either. I think I found the underlying reason. See
https://github.com/schemaorg/schemaorg/issues/2578#issuecomment-632227864 for more information. schema.org's content negotiation has changed in May 2020. Since then, multiple fixes were proposed by various JSON-LD implementations, including https://github.com/RDFLib/rdflib/pull/1125 and https://github.com/lanthaler/JsonLD/commit/f8dff42283d8fb256c0380fc78fe4e585002991e.
Back to the issue, https://schema.org now returns the following Link in the header:
link: </docs/jsonldcontext.jsonld>; rel="alternate"; type="application/ld+json"

Currently, this library only supports rel="http://www.w3.org/ns/json-ld#context" as per JSON-LD 1.1 spec.
Proposed solution
If you use the actual location of schema.org context:
"@context":  "https://schema.org/docs/jsonldcontext.jsonld",

The example should work. Please note that it is considered the best practice to cache context documents in production applications.
We will add support for rel="alternate" in the next release. I can't provide ETA just yet.
Thanks for reporting.

The fix is in the master. It will be included in the next minor release.


Set meaningful titles for the html pages

Make other titles for the pages in this project:

eMTee Showdown - Home
eMTee Showdown - Seasons
eMTee Showdown - Selection
eMTee Showdown - Settings
If you have another idea leave a comment!

Originally posted by @redcrafter502 in https://github.com/eMTeeWare/emtee-showdown/discussions/73

Here is a pull request: #75


ENH: Wrap DisplacementFieldTransform for vector floats

PR Checklist

[x] Added Python wrapping to new files (if any) as described in ITK Software Guide Section 9.5

Refer to the ITK Software Guide for
further development details if necessary.

Recreating PR 2267, was not able to reopen after a force-push squash update. This PR adds float wrapping for DisplacementFieldTransform which is useful in simple cases and where vector float is wrapped. Conditional prescribed by @thewtex in PR 2267 is applied.

Recreating PR 2267, was not able to reopen after a force-push squash update. This PR adds float wrapping for DisplacementFieldTransform which is useful in simple cases and where vector float is wrapped. Conditional prescribed by @thewtex in PR 2267 is applied.


Reading a file creates a Bucket GET request

Mountpoint for Amazon S3 version
mount-s3 1.8.0
AWS Region
us-east-1
Describe the running environment
Locally running mountpoint s3 against an AWS bucket using creds stored in the environment variables. Using Ubuntu 20.04
Mountpoint options
mount-s3 <bucket> <file_dir> --endpoint-url <endpoint> --read-only --force-path-style --auto-unmount --prefix <prefix>

What happened?
I'm trying to fetch thousands of really small files and I realized I was getting rate limited due to a rate limit imposed on the number of Bucket GET requests which are basically operations from mountpoint s3 trying to read the location per each file read.
I am not listing the contents of the bucket. I know what the file names are beforehand and are just reading each location without listing the folder. However, I am getting as many Bucket GET requests as Object GET and Object HEAD requests.
Is this expected? Is there a way to not list the folder every time I do a get request?
Relevant log output
No response

Hi, thank you for opening the issue. I assume that you see unexpected ListObjectsV2 requests and to those you refer with "Bucket GET requests".
Before reading the file, Mountpoint will make both the ListObjectsV2 and HeadObject requests for the specified path. This mechanism is ensuring the shadowing semantics:

Hi, thank you for opening the issue. I assume that you see unexpected ListObjectsV2 requests and to those you refer with "Bucket GET requests". You've mentioned getting rate limited, are you getting 503 errors on ListObjectsV2 requests?
Before reading the file, Mountpoint will make both the ListObjectsV2 and HeadObject requests for the specified path. This mechanism is ensuring the shadowing semantics (e.g. directory dir/ "shadows" the file dir).
There were related issues opened previously:

https://github.com/awslabs/mountpoint-s3/issues/938
https://github.com/awslabs/mountpoint-s3/issues/770

You may avoid repeated ListObjectsV2 operations for the given file by using --metadata-ttl <SECONDS>. Also I see that you're already using the --prefix argument, choosing a longer prefix may reduce the number of ListObjectsV2 in case of nested directories.


Test: Changes view with screen reader

Refs: https://github.com/microsoft/vscode/issues/88695

[x] Win @misolori
[x] any OS @JacksonKearl

Complexity: 3

Note: if you are assigned windows, please use the NVDA screen reader. If you are assigned any OS please either use macOS with VoiceOver or Linux with Orca screen reader.
We have improved our difference view with regards to accessibility. Have a git tracked repostiroy, some file with multiple changes in it and turn on your screen reader. Open the changes view of that file.
Verify:

F7 and shift+F7 navigate you through all the diffs and the screen reader correctly reads the added and removed content
When you enter the accessible Diff view screen reader mentions to use "Stage/unstage/revert selected ranges"
As you navigte through the content, the content is first read out and at the end the line number is read out
You can use "Stage/unstage/revert selected ranges" to stage / unstage/ revert the currently active diff
Pressing Esc takes you out of this view and you are navigated to the regular changes view on the correct position with the right change selected
The whole flow makes sense. And any feedback on improving this is very welcome

@isidorn Please correct me if I'm wrong, but to open the changes view can I choose a file from the list of modified files and press the enter key? If so, I think it would be interesting for the focus to be moved to the open editor as soon as the key is pressed. It took me a while to discover that the editor with the changes was open and I had to use the tab key to find it.

@jvesouza agree with you 100%. Filled this issue to track this https://github.com/microsoft/vscode/issues/93493

Verify:
 `F7` and `shift+F7` navigate you through all the diffs and the screen reader correctly reads the added and removed content

It works like a charm.

 When you enter the accessible Diff view screen reader mentions to use "Stage/unstage/revert selected ranges"

orca doesn't say anything about it.

 As you navigte through the content, the content is first read out and at the end the line number is read out

Correct.

 You can use "Stage/unstage/revert selected ranges" to stage / unstage/ revert the currently active diff

I didn't find a way to do that.

 Pressing `Esc` takes you out of this view and you are navigated to the regular changes view on the correct position with the right change selected

Correct.

 The whole flow makes sense. And any feedback on improving this is very welcome

It seems that I can only navigate the content using the up and down arrow. It would be interesting if we could use left and right, home and end in addition to ctrl + home and ctrl + end.

@jvesouza thanks a lot for trying it out!
You should be able to use F1 > stage selected range if your file is under git source control to stage changes.
Better navigation makes sense. I have created a feature request to track that https://github.com/microsoft/vscode/issues/93498

You should be able to use F1 > stage selected range if your file is under git source control to stage changes.

@isidorn  Thanks for the clarification. Do you think it would make sense to create shortcuts to these functions? Something like: 's' for stage and 'u' for unstage ....

@jvesouza users can define whatever shorcuts he wants for these.
But yes I do agree with you, since this is a readonly view we could have some easy shortcuts.
I have created this issue to track this https://github.com/microsoft/vscode/issues/93564

There's just a few issues with navigating through the list that feel inconsistent like when you have a single range of edits, F7 goes down line-by-line but when you have multiple ranges that shortcut toggles between the different ranges.
It also felt weird that the shortcut to enter this view is also not the same one to exit (you have to hit esc. Not sure if this is common in other modes but we use the same shortcut to toggle various things (sidebar, activity bar, etc.) and would suggest to maybe stick to a single shortcut to toggle and then another to navigate between changes.
Also, should this mode have a setting so users can always set this?
Besides those two things and the other issues i already files, this seems like a really cool mode.

@misolori thanks a lot for feedback.
Furrenlty we use F7 which cycles through all the changes, similar to how F8 cycles through all the errors. Esc exits both of these. And I think it is common for keyboard users to use Esc to get out of things. So that I would not change atm.
I would be open to add a setting to always look at difs in this mode. Or even better if we detect there is a screen reader we could automatically go into this mode. Just an idea, feedback would be great @jvesouza @mehgcap

@isidorn  The idea of automatically jumping into this mode when a screen reader is detected can be interesting, although I believe it is not a crucial thing.


gh-pages failed build?

I am getting gh-pages build fail when using this theme. Full error from Github:
The page build failed for the `gh-pages` branch with the following error:

Your SCSS file `assets/stylesheets/main.scss` has an error on line 11: File to import not found or unreadable: basically-basic/vendor/breakpoint/breakpoint. Load path: _sass. For more information,

I looked at the sass file but it looks okay to me. Any ideas?

The error is your first clue:
Your SCSS file `assets/stylesheets/main.scss` has an error on line 11: File to import not found or unreadable: basically-basic/vendor/breakpoint/breakpoint. Load path: _sass. For more information,

All of the Sass partials in_sass/basically-basic/vendor/ are missing in your repo. If I had to guess you have vendor gitignored in .gitignore and it's not pushing up those files to your GitHub repo. So GH Pages fails when it tries to build since there's a bunch of missing files.


Missing orange validation line in chart

Hello,
I just updated to the newest Digits installed via docker and everything seems to be working fine but during the training the chart only shows the blue loss (train) line.
I am using the same custom MobileNet caffe definition with the changed end of file as pasted below but in the previous Digits version I always had the orange line  "accuracy (val)" but not this time.
Could anyone point me what I am missing?
Thanks a lot!
...
layer {
name: "fc7_custom"
type: "Convolution"
bottom: "pool6"
top: "fc7_custom"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 10
kernel_size: 1
weight_filler {
type: "msra"
}
bias_filler {
type: "constant"
value: 0
}
}
}
layer {
name: "accuracy"
type: "Accuracy"
bottom: "fc7_custom"
bottom: "label"
top: "accuracy"
include { stage: "val" }
}
layer {
name: "loss"
type: "SoftmaxWithLoss"
bottom: "fc7_custom"
bottom: "label"
top: "loss"
exclude { stage: "deploy" }
}
layer {
name: "softmax"
type: "Softmax"
bottom: "fc7_custom"
top: "softmax"
include { stage: "deploy" }
}

I just found it. It was enough to change the layer accuracy from stage:"val" to stage:"train" and now the chart is showing it.


Directory commands bash completion behaves like files

The fzf-completion.bash adds completion to many standard directory commands including cd. But the completion behaves like files: it adds a space instead of a /, which prevent me from keeping tab complete a long path.
The fix is easy: add -o plusdirs for the complete commands for directory commands.

Good point. I'll see what I can do.

Should be fixed now. Let me know if it doesn't work as expected. Thanks.


Use new IPPool in GN controllers

@mangelajo @skitt @tpantelis I should have merge permissions for /pkg/globalnet but I don't see that for this PR. Any idea?


Horizontal infinite scroll not showing pins

If I scroll to right or left, the map loops, but you cannot see the pins over there:

Agreed that this needs to change


Ability to Scan Arbitrary JSON Files

Closes #71
This PR adds the ability to scan any JSON file through a file dialog prompt, which can be accessed through the Scan Files... tool under the Tools context menu.
Multiple selected paths are separated by commas, quotes are optional. Ex: "D:\my file.json", ~\other_file.json
This process is treated as a single scan by the Client, so any paths already scanned through ties to one file, will not be scanned again in another.

Seems to work fine, no bugs detected. Side-effect of the GUI being much faster when downloading (reading cached files is still extremely slow).


Allow config reloader to use compressed files (configmaps and secrets)

The reloader pkg is used by prometheus-operator. A secret is mounted as file, monitored and a reload done if necessary.
Now a secret/configmap is limited to 1mb. We've hit that limit and would like compression to be used here. Of course prometheus-operator will have to write a compressed secret/configmap first.
But anyway, changes to the reloader will be needed to support this use case.
Played around with how to solve this and came up with https://github.com/coreos/prometheus-operator/pull/2243/
If there's any interest I'll cleanup, implement suggestions and submit here.

Valid case, thanks for your PR, let's move implementation discussion there.

This seems to be done (:  https://github.com/improbable-eng/thanos/pull/693


RS backend: Implement international scheduled payments funds confirmation

Description
The API /backoffice/payment-funds-confirmation was changed to use as a response body the class OBWriteFundsConfirmationResponse1.

[ ] The currency needs to be converter if necessary.
[ ] Check if required any change to support International scheduled Payment Funds confirmation
[ ] Write the functional tests related with international scheduled payment funds confirmation
[ ] Write postman request to cover the international scheduled payment funds confirmation

Acceptance criteria

[ ] International scheduled payment funds confirmation has been implemented
[ ] All tests passed

Hey team! Please add your planning poker estimate with ZenHub @andra-racovita @frlaura-jianu @mariantiris


Can't contribute.

I can't offer pull requests against your repository.
GitHub issue screenshot:

Thank you for wanting to contribute! You need to fork the repository and open a pull request from your fork.


How to implement the 3rd party plugin without support SSR ?

Bug Report or Feature Request (mark with an x)
- [ ] bug report -> please search issues before submitting
- [x] feature request

Hello,
WIP on integrating another 3rd party plugin without SSR support (https://github.com/zdy1988/vue-jstree) and really sorry to disturb you again. I'm looking forward to figuring out a solution (tuto or example) solving this kind of 3rd party plugin integration issue once and for all. As someone indeed published a tuto to introduce how fix it in Nuxt (i.e. https://medium.com/@codebeast_/why-your-third-party-plugin-dont-work-in-nuxt-and-how-to-fix-it-d1a8caadf422)
Will be grateful for any tips and please let me know if we've documented somewhere yet.
Versions.
browser:
browser version:
operating system:

Repro steps.

Desired functionality.

Mention any other details that might be useful.

@be-next-hotdog can I close this issue?

@devCrossNet sorry guy to reply you so late (was on vacations). I tested quickly your solution, but the re-render mechanism impacts slightly the rendering of several charts. Please tell me if you figure out a better solution, otherwise I'll redefine the page layout and move the tree viewer to a more independent work panel.
So grateful to your tips anyway :)


[BUG] Request.formData() is not a function

Describe the bug
The following error occurs when using the latest version of Hydrogen:

error: TypeError: req.formData is not a function

This is because we no longer use the node-fetch polyfill for fetch since it is now built into more recent Node versions. Hydrogen should ensure the FormData object is always available so the API is consistent across platforms.
To Reproduce
Call request.formData() inside a server component or an API function in Hydrogen running on Node 17+.
Expected behaviour
It should work as normal and return a FormData object.
Additional context

Hydrogen version: 0.23.0
Node version: 17.2.0
Device details: Macbook Pro M1

@vlucas it turns out this is only an issue in node v17. Node 16 and 18 don't have this problem. It's because Node 18's implementation of fetch includes FormData, whereas 17 doesn't. Node 16 doesn't implement fetch at all, so the entire thing is polyfilled. Rather than coming up with a partial polyfill, and because 17 is an unstable version, I think it's okay that we don't fix this.

Agreed. I will update my local version of Node. 👍


refactor: clean up scripts functionality

no need to define in recipe
support both pre and post scripts
scripts/pre & scripts/post

Oh wow... I actually didn't see any of these tickets before I made the big pull request, hehe.

no need to define in recipe

I would say that there are some strong needs for having to define the script list in the recipe, for 3 reasons:

Multiple recipes can be defined, each running different scripts. This is the hardest thing to solve if explicit script lists are removed.
"Library" / "Helper" scripts can be included, which won't auto-run and will simply be included or executed by the actual scripts you do want to run. For example, you might have a helper script that interacts with some online service to fetch some data. By itself, it's useless. But you need to call it from your main script. Currently, this is easy; you just put both in the "scripts" folder and only call the "main" script from the recipe. If it's changed to auto-run all scripts, then there needs to be something like a scripts/lib folder that gets included without auto-running.
The recipe also ensures that scripts run in an exact, specific order. Although that can usually be solved with filename tricks (10-run_me_early.sh vs 99-run_me_last.sh).

The idea of having pre/post scripts is great though. That could be added pretty easily, with a .scripts.pre[] and .scripts.post[] section in the yaml which simply is two separate lists of which scripts to run. And there wouldn't be any need to separate them into different folders. Just some yaml and build.sh changes.

I just had an idea...
The big issues that are created by auto-running scripts could be shoveled down into being the responsibility of a script instead.
Meaning: We (or someone else) can create a script that simply runs all other scripts. The user then simply has to include THAT script in their recipe.yml and they'll get the desired effect. Without having to break the great features I mentioned above.
I've finished implementing the pre/post script system and it's robust enough that I'll add it to the pull request. :)

I was planning on making this very simple, where everything is a "script" and they're ran in the exact order specified in the recipe. But this smells like bash scripting, and I trust anybody other than me to do that...

where everything is a "script" and they're ran in the exact order specified in the recipe.

@EinoHR I'm not sure what you;'re referring to? The first bullet point of your original list was "no need to define in recipe" which I interpreted as "just automatically run every script in the folders". Which is a great idea, so that's what I implemented via the autorunner. :) But since an autorunner can conflict with the flexibility of building multiple different recipe.yml files with different script requirements in each, it was implemented as an included script module, autorun.sh.
This new setup gives people the best of both worlds. In the new default recipe.yml, the autorunner is enabled for both script stages, and people just need to dump scripts into scripts/pre/*.sh and scripts/post/*.sh and can relax and enjoy the magic. :)
But anyone who has more requirements than that can use the manual method, or both methods combined (via the techniques described in the inline code documentation of autorun.sh).
If there's any other ideas or use-cases I've missed, please let me know! :)

I'm not sure what you're referring to?

Just something I was quietly planning, not something I wrote in the original issue (more of a reminded for myself, really). I'm just not a wizard enough to do what you did, so I had planned to implement a way simpler system, that could separate things from build.sh  like adding the flatpaks and installing rpms as scripts with a specific order set in the recipe.

@EinoHR Ahh okay, I understand. :) Well I am happy to contribute scripts with "two decades of heavy bash scripting knowledge". It can often feel useless to have this knowledge, since so many projects are written in modern languages and don't need much scripting, so it's nice that it finally comes to some use here for this build system! :heart:

so many projects are written in modern languages

I did fantasize about a version of this that feels like real programming the other day... Like parsing a yml file with a library, generating a Containerfile based on it, building it and doing all that signing and ghcr pushing stuff, all through a cli.

Haha yeah I had the same thought that it would be nice to have a "proper" build tool. Maybe someone will do it as a future project enhancement. But the current scripting is a nice solution anyway. It's robust, the error-checking is strict, and it's really easy to use now. Just a recipe.yml and the scripts/*-folders, for most people! :)


Route data from 2 serial ports (2 drones connected to same computer)

I'm facing an interesting challenge of reading telem data of 2 different drones in MAVSDK.
The aim is to find distance between the 2 drones using telemetry data. I'm using MAVSDK-python to get drone data and mavlink-router to read the data from 2 serial ports.
My main.conf file looks like:
[General]

[UartEndpoint sik_drone1]
Device = /dev/ttyUSB0
Baud = 57600

[UdpEndpoint sik_drone1]
Mode = Normal
Address = <IP_ADDRESS>
Port = 11000

[UartEndpoint sik_drone2]
Device = /dev/ttyACM0
Baud = 57600

[UdpEndpoint sik_drone2]
Mode = Normal
Address = <IP_ADDRESS>
Port = 12000

and a simple MAVSDK file to read drone id looks like:
#!/usr/bin/env python3

import asyncio
from mavsdk import System

async def run():
    drone = System()
    await drone.connect(system_address="udp://:11000")

    drone2 = System()
    await drone2.connect(system_address="udp://:12000")

    print("Waiting for drone to connect...")
    async for state in drone.core.connection_state():
        if state.is_connected:
            print(f"Drone discovered with UUID: {state.uuid}")
            break

    print("Waiting for drone2 to connect...")
    async for state in drone2.core.connection_state():
        if state.is_connected:
            print(f"Drone2 discovered with UUID: {state.uuid}")
            break

    # version_info = await drone.info.get_version()
    # print(version_info)

    id_info = await drone.info.get_identification()
    print(id_info)

    id_info2 = await drone2.info.get_identification()
    print(id_info2)

if __name__ == "__main__":
    loop = asyncio.get_event_loop()
    loop.run_until_complete(run())

But the output I get is the id of only a single drone.
Hence, how should I pair the UDP port with serial port so that when I connect a UDP in MAVSDK I get data of that particular drone only.

Can you get them to work one at a time?
if yes:
Verify different sys_id (I assume you have already done this)
Try to give endpoints non-similar names
Try to start two separate mavlink-routerd and have them point to each other. you might have to use mode = eavesedropping.
ir no:
something wrong other than mavlink-router

Can you get them to work one at a time?
if yes:
Verify different sys_id (I assume you have already done this)
Try to give endpoints non-similar names
Try to start two separate mavlink-routerd and have them point to each other. you might have to use mode = eavesedropping.
ir no:
something wrong other than mavlink-router

Hi @andreastoellefsen yes i'm able to get them work one at a time.
I also tried giving different name to all endpoints. Code below
[General]

[UartEndpoint sik_drone1]
Device = /dev/ttyUSB0
Baud = 57600

[UdpEndpoint udp_of_sik_drone1]
Mode = Normal
Address = <IP_ADDRESS>
Port = 11000

[UartEndpoint sik_drone2]
Device = /dev/ttyACM0
Baud = 57600

[UdpEndpoint udp_of_sik_drone2]
Mode = Normal
Address = <IP_ADDRESS>
Port = 12000

The mavlink router using this config file runs without errors. But, it randomly sends telem data from Uart to Udp. Sometimes drone1 telem data to both udp endpoints, sometimes different, sometimes drone2 telem data to both udp endpoints. There is no control as in to specifically map drone1 telem data to a particular udp endpoint (say udp_of_sik_drone1).
Then, I tried to start 2 seperate mavlink-routerd but I get this error when I start the second mavlink-routerd (Could not bind to tcp socket (Address already in use) )
Thanks

First of all, I like to clarify how mavlink-router works. All telemetry messages received by one endpoint will get routed to all other endpoints (generally speaking). So both UDP endpoints will get the telemetry streams from both vehicles. (Commands addressed to a specific system ID will be routed to just one endpoint, though.)
So as far as I can tell, there are two options now:

Just use one UDP endpoint to connect to your application (and two UART endpoints to connect both drones). The only issue is, that MAVSDK-Python doesn't seem to support multiple vehicles (see https://github.com/mavlink/MAVSDK-Python/issues/102). (It's possible in C++ though to get a list of all discovered systems. I'm using it in one project.)
Use two mavlink-router instances (one for each UART-UDP pair) and your current code should work just fine. But then you wouldn't need mavlink-router because MAVSDK-Python can also connect to serial.

Closing because of inactivity.
Summary of the problem: Receive the data of two different drones (connected via two UART endpoints) with MAVSDK Python. Multiple drones on one link are not supported (yet) by MAVSDK-Python. So it was requested to have mavlink-router only route packets between certain endpoints (a UART and UDP pair each), like VLANs, which is also not currently implemented.
Workaround: Using multiple mavlink-router instances for the different communication links.
An outgoing filter by sysID on each endpoint was proposed in #257.


Improved Kotlin support

Improved Kotlin support

added Mvn support
support the latest Kotlin release, i.e. 1.2.51 set in the pom.xml
testing is now done using Kotlin rules via JUnit
generated boilerplates now uses more Kotlin idioms
fixes https://github.com/fnproject/cli/issues/262

My bad! It's now dynamic.


Merge with upstream [ODC-764]

Intent
To merge with upstream. This will allow us to better merge our changes into the upstream.
Items Requiring More Thorough Review
Files with Merge Conflicts / Manual Changes
Merge conflicts:

go.mod
go.sum
sentry/rules.go (deleted by them)

Upstream changes in design:
sentry/sentry.go: (these lines)

Upstream refactored this work to remove sling.

sentry/project_filter.go - amended this to use client instead of sling

Upstream refactored this work to remove sling.
Upstream used new test setup and teardown functionality.

I created a PR into upstream here


Finally update "dind" wrapper to the latest commit

Users on versions older than 1.8 should probably upgrade at this point.
Using something like -v /sys/fs/cgroup:/sys/fs/cgroup on 1.6 and 1.7 is probably the only workaround to this update.
For reference:
$ GIT_PAGER=cat git diff 3b5fac462d21ca164b3778647420016315289034...52379fa76dee07ca038624d639d9e14f4fb719ff -- hack/dind
diff --git a/hack/dind b/hack/dind
index a8c09283f6..3254f9dbe7 100755
--- a/hack/dind
+++ b/hack/dind
@@ -1,11 +1,11 @@
-#!/bin/bash
+#!/usr/bin/env bash
 set -e

 # DinD: a wrapper script which allows docker to be run inside a docker container.
 # Original version by Jerome Petazzoni<EMAIL_ADDRESS> # See the blog post: https://blog.docker.com/2013/09/docker-can-now-run-within-docker/
 #
-# This script should be executed inside a docker container in privilieged mode
+# This script should be executed inside a docker container in privileged mode
 # ('docker run --privileged', introduced in docker 0.6).

 # Usage: dind CMD [ARG...]
@@ -13,74 +13,6 @@ set -e
 # apparmor sucks and Docker needs to know that it's in a container (c) @tianon
 export container=docker

-# as of docker 1.8, cgroups will be mounted in the container
-if ! mountpoint -q /sys/fs/cgroup; then
-
-	# First, make sure that cgroups are mounted correctly.
-	CGROUP=/cgroup
-
-	mkdir -p "$CGROUP"
-
-	if ! mountpoint -q "$CGROUP"; then
-		mount -n -t tmpfs -o uid=0,gid=0,mode=0755 cgroup $CGROUP || {
-			echo >&2 'Could not make a tmpfs mount. Did you use --privileged?'
-			exit 1
-		}
-	fi
-
-	# Mount the cgroup hierarchies exactly as they are in the parent system.
-	for HIER in $(cut -d: -f2 /proc/1/cgroup); do
-
-		SUBSYSTEMS="${HIER%name=*}"
-
-		# If cgroup hierarchy is named(mounted with "-o name=foo") we
-		# need to mount it in $CGROUP/foo to create exect same
-		# directoryes as on host. Else we need to mount it as is e.g.
-		# "subsys1,subsys2" if it has two subsystems
-
-		# Named, control-less cgroups are mounted with "-o name=foo"
-		# (and appear as such under /proc/<pid>/cgroup) but are usually
-		# mounted on a directory named "foo" (without the "name=" prefix).
-		# Systemd and OpenRC (and possibly others) both create such a
-		# cgroup. So just mount them on directory $CGROUP/foo.
-
-		OHIER=$HIER
-		HIER="${HIER#*name=}"
-
-		mkdir -p "$CGROUP/$HIER"
-
-		if ! mountpoint -q "$CGROUP/$HIER"; then
-			mount -n -t cgroup -o "$OHIER" cgroup "$CGROUP/$HIER"
-		fi
-
-		# Likewise, on at least one system, it has been reported that
-		# systemd would mount the CPU and CPU accounting controllers
-		# (respectively "cpu" and "cpuacct") with "-o cpuacct,cpu"
-		# but on a directory called "cpu,cpuacct" (note the inversion
-		# in the order of the groups). This tries to work around it.
-
-		if [ "$HIER" = 'cpuacct,cpu' ]; then
-			ln -s "$HIER" "$CGROUP/cpu,cpuacct"
-		fi
-
-		# If hierarchy has multiple subsystems, in /proc/<pid>/cgroup
-		# we will see ":subsys1,subsys2,subsys3,name=foo:" substring,
-		# we need to mount it to "$CGROUP/foo" and if there were no
-		# name to "$CGROUP/subsys1,subsys2,subsys3", so we must create
-		# symlinks for docker daemon to find these subsystems:
-		# ln -s $CGROUP/foo $CGROUP/subsys1
-		# ln -s $CGROUP/subsys1,subsys2,subsys3 $CGROUP/subsys1
-
-		if [ "$SUBSYSTEMS" != "${SUBSYSTEMS//,/ }" ]; then
-			SUBSYSTEMS="${SUBSYSTEMS//,/ }"
-			for SUBSYS in $SUBSYSTEMS
-			do
-				ln -s "$CGROUP/$HIER" "$CGROUP/$SUBSYS"
-			done
-		fi
-	done
-fi
-
 if [ -d /sys/kernel/security ] && ! mountpoint -q /sys/kernel/security; then
 	mount -t securityfs none /sys/kernel/security || {
 		echo >&2 'Could not mount /sys/kernel/security.'
@@ -88,16 +20,6 @@ if [ -d /sys/kernel/security ] && ! mountpoint -q /sys/kernel/security; then
 	}
 fi

-# Note: as I write those lines, the LXC userland tools cannot setup
-# a "sub-container" properly if the "devices" cgroup is not in its
-# own hierarchy. Let's detect this and issue a warning.
-if ! grep -q :devices: /proc/1/cgroup; then
-	echo >&2 'WARNING: the "devices" cgroup should be in its own hierarchy.'
-fi
-if ! grep -qw devices /proc/1/cgroup; then
-	echo >&2 'WARNING: it looks like the "devices" cgroup is not mounted.'
-fi
-
 # Mount /tmp (conditionally)
 if ! mountpoint -q /tmp; then
 	mount -t tmpfs none /tmp

Sorry @yosifkit, this doesn't help with docker run --rm docker:dind --help, but docker run --rm docker dockerd --help should be a reasonable substitute (you'll just get a friendly little clippy note along with it).


Add appveyor CI

You should probably use Appveyor as well as Travis because Travis only tests on Linux, while appveyor tests on Windows. There might be a build which passes Travis, but fails to work on your Windows computer.

I'm open to this, this sounds like a good idea. Would you like to open a PR demonstrating it? Target master please

Useful Link: https://www.appveyor.com/

I've made a Pull Request #92.

Closed by #92. Again thank you again for this recommendation it was a great idea!


StreamingContextIpcProxy.DirectKafkaStream doesn't work in Spark 1.6.0

In StreamingContextIpcProxy.DirectKafkaStream, it calls the following method in Java side:
org.apache.spark.streaming.kafka.KafkaUtilsPythonHelper.createDirectStream
But this method doesn't exist in Spark 1.6.0

Fixed in https://github.com/Microsoft/Mobius/commit/db13e20118898f3c029655df0121370e16265ac0


receive: wasting CPU on GC

Thanos, Prometheus and Golang version used:
thanos, version 0.32.5 (branch: HEAD, revision: 750e8a94eed5226cd4562117295d540a968c163c)
  build user:       root@053ebc7b5322
  build date:       20231019-04:13:41
  go version:       go1.21.3
  platform:         linux/amd64
  tags:             netgo

Object Storage Provider: s3
What happened: after running for some time, receive pegs CPU.
What you expected to happen: CPU usage to be proportional to write load
How to reproduce it (as minimally and precisely as possible):
Full logs to relevant components:

Anything else we need to know:
https://pprof.me/aa81313c5472bcec2e81765384e11748

What options do you have enabled? Have you tried --writer.intern?

To add to that, would be great to see the full configuration of the receiver including flags and hashring. It looks like it's stuck in GC so I wonder if there is a routing loop.

receive
--log.level=info
--log.format=logfmt
--grpc-address=<IP_ADDRESS>:10901
--http-address=<IP_ADDRESS>:10902
--remote-write.address=<IP_ADDRESS>:19291
--objstore.config=$(OBJSTORE_CONFIG)
--tsdb.path=/var/thanos/receive
--label=thanos_receive_replica="$(NAME)"
--label=receive="true"
--tsdb.retention=26h
--receive.local-endpoint=$(NAME).thanos-receive-headless.$(NAMESPACE).svc.cluster.local.:10901
--grpc-server-tls-cert=/cert/tls.crt
--grpc-server-tls-key=/cert/tls.key
--grpc-server-tls-client-ca=/cert/ca.crt
--label=metrics_namespace="global"
--receive.tenant-label-name=cluster
--receive.default-tenant-id=unknown
--receive.hashrings-file-refresh-interval=1m
--remote-write.server-tls-cert=/cert/tls.crt
--remote-write.server-tls-client-ca=/cert/ca.crt
--remote-write.server-tls-key=/cert/tls.key
--tsdb.memory-snapshot-on-shutdown
--tsdb.max-block-duration=1h
--tsdb.min-block-duration=1h
--writer.intern

We're running with distributor:
receive
--log.level=info
--log.format=logfmt
--grpc-address=<IP_ADDRESS>:10901
--http-address=<IP_ADDRESS>:10902
--remote-write.address=<IP_ADDRESS>:19291
--label=replica="$(NAME)"
--label=receive="true"
--receive.hashrings-file=/var/lib/thanos-receive/hashrings.json
--receive.replication-factor=1
--grpc-server-tls-cert=/cert/tls.crt
--grpc-server-tls-key=/cert/tls.key
--grpc-server-tls-client-ca=/cert/ca.crt
--receive.grpc-compression=snappy
--receive-forward-timeout=30s
--receive.hashrings-algorithm=ketama
--receive.hashrings-file-refresh-interval=1m
--receive.relabel-config=$(RECEIVE_RELABEL_CONFIG)
--receive.tenant-label-name=cluster
--receive.default-tenant-id=unknown
--remote-write.client-tls-ca=/cert/ca.crt
--remote-write.client-tls-cert=/cert/tls.crt
--remote-write.client-tls-key=/cert/tls.key
--remote-write.client-server-name=thanos-receive-headless.monitoring.svc.cluster.local
--remote-write.server-tls-cert=/cert/tls.crt
--remote-write.server-tls-client-ca=/cert/ca.crt
--remote-write.server-tls-key=/cert/tls.key

The hashring is managed by https://github.com/observatorium/thanos-receive-controller

I cannot see anything wrong in the configuration. Maybe you can take a look at an allocation profile to see where objects are being allocated.

Is the problematic one the router or the ingester?

Is the problematic one the router or the ingester?

Ingester

Please try out the capnproto replication available on main.


os x 10.14 autoconf error: This is libtool 2.2.6b, but this LT_INIT comes from libtool 2.4.6.

Any ideas on this one?
I've tried re-running autoreconf -fi, which is what seems to be the suggested action, but get the same error.

How did you download jansson?  IE do you have a git clone or a tarball download, and if you have a tarball where did you download from?

git clone from gh
Sent from my iPhone

On Mar 10, 2019, at 6:36 PM, Corey Farrell<EMAIL_ADDRESS>wrote:
How did you download jansson? IE do you have a git clone or a tarball download, and if you have a tarball where did you download from?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

I suspect this is an issue with your local build toolchain, possibly some kind of mismatch among your autotools (aclocal, autoconf, libtool).  I'm not knowledgeable enough about OSX to be able to suggest a fix for this.
If you have cmake you might have better luck using that to build jansson until someone can give a better idea what's going on with your autotools.

I tend to think you're right (about it having to do with my local toolchain).  Closing this.


Optimize code for the whole project

Consider adding thread synchronization (e.g., using Lock) when accessing shared resources like lidar_data_buffer to prevent potential race conditions in multi-threaded operations.

Solved the above in 077b847

Updates in 408ff72

Add explicit error handling for missing ego vehicle in waypoint_manager.py

Added communication pooling for TCP/IP connection in proximity_mapping.py

Added class ConnectionPool
- Efficiency: Reduces overhead from repeatedly opening and closing connections.
- Performance: Minimizes latency by reusing existing connections.
- Scalability: Handles multiple communications efficiently.
Added Periodic cleanup to auto clean idle connections.


[MP Website] Update working group page on MP.io

This correspondence was an inspiration to this issue. The info about WG can be really tricky to find. I'm adding my suggestions below.
We need to:

update https://microprofile.io/workinggroup/ with the list of the members (bullet points?)
are all the logos up there in the header?
explain Steering Committee and Working Group relationship

@debbiehoffman I tried adding you to this issue, but you have not yet accepted invite to this repo. Can you do it, so I can add you to assignees? 🙂

Rustam,
Thanks for summing up. I've already created task for the site update
[MP Site] Add iJUG and Fujitsu Logos to Member Page
https://github.com/eclipse/microprofile-marketing/issues/481
as well as tasks to receive the required logos

iJUG #479
https://github.com/eclipse/microprofile-marketing/issues/479
Fujitsu #480
https://github.com/eclipse/microprofile-marketing/issues/480

So let's close this issue not to keep duplicates.
On Tue, 13 Apr 2021 at 00:06, Rustam Mehmandarov @.***>
wrote:

Assigned #77 https://github.com/microprofile/microprofile-wg/issues/77
to @TetianaFTV https://github.com/TetianaFTV.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/microprofile/microprofile-wg/issues/77#event-4584798471,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJHFTS3U2MOPQAC4R4AO5NTTINVGBANCNFSM422D5ZYA
.

--

https://jelastic.com/blog/email-banner/*
Tetiana Fydorenchyk
VP of Marketing @ Jelastic https://jelastic.com/?utm_source=footer
https://twitter.com/tetiana_ftvTwitter https://twitter.com/tetiana_ftv
Facebook https://www.facebook.com/tetiana.ftv LinkedIn
https://www.linkedin.com/in/tetiana-fydorenchyk-95603125/

This is great. I saw it just now, but this issue is also about restructuring the content of the site to make it more accessible/easy to find.

Hey you two, this ticket is 3 months. have we improve the data in the MPWG page?
What else is missing?

many updates have been put into the MPWG https://microprofile.io/workinggroup/
Living improvements, submit a new git ticket for specific features that ought to be considered.


Adapt BadActors list

There is badactors list which is used for transfers, these account's intent is to take advantage of mistype errors. Please adapt this so that whenever user enters or mistypes and gets these usernames, warn them about account being Bad Actor / mistyped account name detected?!
https://github.com/steemit/condenser/blob/master/src/app/utils/BadActorList.js

Adapted https://github.com/esteemapp/esteem-surfer/commit/57ab6eb532fcc528e15ab75c40ee5b72d8806ca9


added tab to navigate calendar screen

Date: 19 March 2024

Developer Name: Shreya

Issue Ticket Number

https://github.com/Real-Dev-Squad/mobile-app/issues/407
Description

Tab for calendar screen
Screeshot

Documentation Updated?

[ ] Yes
[✅  ] No

Under Feature Flag

[✅  ] Yes
[ ] No

Database Changes

[ ] Yes
[ ] No

Breaking Changes

[ ] Yes
[✅  ] No

Development Tested?

[✅  ] Yes
[ ] No

Screenshots

Screenshot 1

Test Coverage

Screenshot 1

Additional Notes

Please review your changes once before sending the PR for review.

reviewed

coverage number, please

no able to get that as all previously written test cases are failing.


New version: danstis.rmstale version 1.12.1

Checklist for Pull Requests

[x] Have you signed the Contributor License Agreement?
[ ] Is there a linked Issue?

Manifests

[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?

[x] Does your manifest conform to the 1.6 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Hi @danstis,
The package didn't pass a Defender or similar security scan. This might be a false positive and we can rescan tomorrow.
(Automated response - build 876.)

Automatic Validation ended with:

Installation failed with exit code -1978335187
2024-03-29 00:25:05.372 [FAIL] Installer failed security check. Url: https://github.com/danstis/rmstale/releases/download/v1.12.1/rmstale_1.12.1_windows_amd64.zip Result: 0x80004005

(Automated response - build 876.)

@wingetbot run

@stephengillie I figure this false positive is coming from one of my dependencies, I will push a new build with that dependency replaced to try and quiet the issue for the future.

I've heard that sometimes, Defender teams might install an application in a VM and let it sit, to make sure there's no "time-release malware" that might release after a few days of being installed. Some packages have lingered in this "Defender loop" for a week or more before passing.


Fixed Footer section issue in Rate Us page ! #3500

Hello, PR
Fixed issue number - #3500
Issue Fixed -
https://github.com/user-attachments/assets/93df4cf3-c20d-44e0-8313-f6276a89747a

Description
[I fixed these all issue - In Footer texts misalignment, add text boxes gap & same background color as footer color, all social media icons color different in Rate Us page.. add icons & text color under Quick links]

Type of PR

[x] Bug fix
[x] Feature enhancement
[x] Documentation update
[ ] Other (specify): _______________

Checklist:

[x] I have made this change from my own.
[x] I have taken help from some online resources.
[x] My code follows the style guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] I have made corresponding changes to the documentation.
[x] My changes generate no new warnings.
[x] I have tested the changes thoroughly before submitting this pull request.
[x] I have provided relevant issue numbers and screenshots after making the changes.

@sailaja-adapa ma'am kindly upgrade the level 1 to 2, because if I had made 3 separate pull requests I would get three level 1 but I fixed these issues in one pull request because I don't have much time... you can check my code, screenshots & video..
I hope you understand me, Thank You

Done

Done

Thanks a lot 🙏🏻


SliverAppBar Control

https://api.flutter.dev/flutter/material/SliverAppBar-class.html

duplicate https://github.com/flet-dev/flet/issues/1843


Set up a website for demos/tutorials

Once we create nice web-based demos, we should host them somehow so we can share the link with others!

Resolved by @satnam6502 in #614 #615 #616 and others :tada:


Add short support channel summary in README

Its short and inviting and right at the beginning to make it harder to miss.

LGTM


Issue 94 log confusion matrix

Resolves
Fixes #94
Description
Added the ability to save confusion matrix to a separate table along with json serialized string representation of the confusion matrix

I think you're on the right track @AnoojNair, and I apologize if I'm being nit-picky right now (which I may be :)
What I think we should do is create an ConfusionMatrix and a ConfusionMatrixEntity. We can expose the ConfusionMatrix to the world, but keep the entity strictly for storage.
Suggested structure
public class IConfusionMatrixEntity
{
    public Guid Id { get; set; }

    public Guid RunId { get; set; }

    public string SerializedMatrix { get; set; }
}

public class ConfusionMatrix
{
    //this will be a mirror image of ML.NET's confusion matrix will be serialied down as you do right now into SerializedMatrix
}

The goal here is not to tie our database schema to that of ML.NET but instead have another POCO in between to decouple us.

Let me know if you want me to open an example PR of this change, or have any additional questions. I like where you're otherwise taking this PR so far!

@aslotte ...Now  i get it :) . .

Great @AnoojNair - I added some minor suggestions but looks great overall!

Thanks @aslotte , i have made the changes.

Thank you @AnoojNair for your contribution!


Background Replacement Images are not scaling as per the video tile

Describe the bug
In our react native application we are using base64 images on native android side for background replacement functionality. But in our case the image is getting upscaled and only a part of the image is being set to the background of the video tile.
Please suggest.
To set the image as a background I have performed the following steps:
Calling native method through bridge:
          RNFetchBlob.fetch(             "GET",             "https://images.generated.photos/WFfsbGAPqoAQywfdZ0VDZEnXexq5eLoEiJyBdK_2PVM/rs:fit:256:256/czM6Ly9pY29uczgu/Z3Bob3Rvcy1wcm9k/LnBob3Rvcy92M18w/NjA1MzgxLmpwZw.jpg"           )             .then((res) => {               console.log(res);               let status = res.info().status;               console.log(status);               if (status == 200) {                 let base64 = res.base64();                 **NativeFunction.convertImageToBitmap(                   !isVoiceFocusEnabled,                   base64                 );**               }             })             .catch((error) => {               console.log("Error occured", error);             });
I have converted base64(Which is passed from react native side iteself) formatted image to bitmap:
`    @ReactMethod
fun convertImageToBitmap(enabled: Boolean, base64String: String, screenWidth: Int, screenHeight: Int) {
    try {
        val decodedString = Base64.decode(base64String, Base64.DEFAULT)
        logger.info(TAG, "decode base 64 string is: ${decodedString}")
        val decodedByte = BitmapFactory.decodeByteArray(decodedString, 0, decodedString.size)
        replaceBackgroundImage(enabled, decodedByte)
    } catch (e: IOException) {
        logger.info(TAG, "Bitmap conversion failed ${e}")
    }

}`

After this conversion I have passed this image to BackgroundReplacementConfiguration:
`
fun replaceBackgroundImage(enabled: Boolean, bitmapImage: Bitmap) {
logger.info(TAG, "Background replacement functionality: ${enabled}")
if(enabled) {
val surfaceTextureCaptureSourceFactory = DefaultSurfaceTextureCaptureSourceFactory(logger, eglCoreFactory)
val cameraCaptureSource= DefaultCameraCaptureSource(reactApplicationContext, logger, surfaceTextureCaptureSourceFactory)
     val backgroundReplacementVideoFrameProcessor = BackgroundReplacementVideoFrameProcessor(
         ConsoleLogger(LogLevel.DEBUG),
         eglCoreFactory,
         reactApplicationContext,
         BackgroundReplacementConfiguration(bitmapImage)
     )

     cameraCaptureSource.addVideoSink(backgroundReplacementVideoFrameProcessor)
     meetingSession?.audioVideo?.startLocalVideo(backgroundReplacementVideoFrameProcessor)
     cameraCaptureSource.start();
 } else {
     meetingSession?.audioVideo?.startLocalVideo()
 }

}
`
But unfortunately, I am not able to set it properly.

To Reproduce
Steps to reproduce the behavior:
Implement the react native demo project as per the guidelines from React Native Chime itself
Implement background image replacement filter as per the documentation or you can use above code also.
Join the meeting (There is no need to join from remote partcipant. you can see the image getting scaled on local side also)
Expected behavior
Image should have scaled as per the video frame dimensions.
Test environment Info (please complete the following information):

Device: Lenovo TB-8705F
OS: Android 10
Version amazon-chime-sdk: 0.17.0
Version amazon-chime-sdk-media: : 0.17.0
Version amazon-chime-sdk-media-machine-learning : 0.1.0

Additional context
I cannot downscale or upscaled the image as per the device dimension. Please assist
I have tried some kotlin approaches - BitmapFactory.Options().inSample image options and createScaledBitmap functions etc... none of them worked.
Kindly, let me know if my approach is correct or not? and if not then how should I make update the code.
Thank you

Thank you for opening issue. We'll look into it and update the ticket.

Thanks for pointing this out. I tested the image you gave against the changes in https://github.com/aws/amazon-chime-sdk-android/pull/459 and I believe it should be fixed after the PR is merged. i.e. this appears to be the same issue as https://github.com/aws-samples/amazon-chime-react-native-demo/issues/145 where the scaling of the images was done incorrectly.

Hey @hokyungh , @richhx ,
Thanks for reply and support. Waiting for PR merge.

Thank you @richhx , I will take a look into it again. Thanks

This code has been released as of 0.17.2. Closing. Free free to reopen if you see any issue with latest.


Tooltip units

Convert units in tooltips to use same format as widgets. Currently they are just regular floats.

The data we have is minutes with decimals (ex: 5.67 minutes). Annoying to convert to minutes + seconds. Unsure if chart.js is doing this, or if this is how the numbers come from our backend. If they come this way from the backend, we can fix this and just send seconds


Security issues with Shipyard?

I had 2 servers with Shipyard running, they both had strange processes running like /usr/bin/iptab (100% cpu) and /usr/bin/.ssh. Also there where iptables rules added:
Chain INPUT (policy ACCEPT)
target     prot opt source               destination
DROP       all  --  <IP_ADDRESS>        anywhere
DROP       all  --  <IP_ADDRESS>         anywhere
ACCEPT     tcp  --  <IP_ADDRESS>/24      anywhere             tcp dpt:2375
ACCEPT     tcp  --  <IP_ADDRESS>/24       anywhere             tcp dpt:2375

Are these instances accessible to the public?  If so you should use TLS as
recommended in the docs.
On Jun 25, 2016 2:07 PM, "mgielissen"<EMAIL_ADDRESS>wrote:

I had 2 servers with Shipyard running, they both had strange processes
running like /usr/sbin/iptab and /usr/bin/.ssh. Also there where iptables
rules added:
Chain INPUT (policy ACCEPT)
target prot opt source destination
DROP all -- <IP_ADDRESS> anywhere
DROP all -- <IP_ADDRESS> anywhere
ACCEPT tcp -- <IP_ADDRESS>/24 anywhere tcp dpt:2375
ACCEPT tcp -- <IP_ADDRESS>/24 anywhere tcp dpt:2375
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/shipyard/shipyard/issues/835, or mute the thread
https://github.com/notifications/unsubscribe/AAP6IuM2nN5TqjK3WIIBpx0QZf1BVskoks5qPW54gaJpZM4I-ZeA
.

@ehazlett @mgielissen I have same issue with it. I deployed the shipyard server on the public.
A few days later, I got suspected malicious IP address connected to shipyard docker image

And I found my server has been hacked and running a malicious program

The “2498” program reported as malicious form virustotal
https://www.virustotal.com/en/file/3dddc7bda6f1b8bef320d2046199cc8ae4cf715e7216cc221171a268f671ff10/analysis/

It's generating a lot of outbound traffic.

Yes, indeed. My server generated about 900GB in 5 days.

We noticed the same issue.
Reviewing the logs on the host server looks like it was being used as part of a DDoS attack.
Indeed the malware installed seems to be used exclusively for DDoS. "Portbet" - md5sum 98eb47a21ffeb1ed1966f89375e843c3 this is different to the one John-Lin posted.
The attacker seems to have been able to connect to the host from the docker container, we are going to look at namespaces to avoid giving root to compromised containers in the future.  There was a good presentation about namespaces at BSides London a few feeks back: https://www.youtube.com/watch?v=uQigvjSXMLw
The attacker has tried to cover their tracks by deleting files and logs, luckily the diskspace had not been overwritten so I could recover the files to try and workout what they were up to.
The attacker also seems to have created a local account and home dir which contained the malware.
At the moment we are assuming a vulnerability exists within the shipyard container, but as yet I have not identified it. Anyone else had any luck identifying the route in?

There is no vulnerability in the container. You are effectively opening up
your host to the public. (this is the same as the docker docs where they
state to use TLS if it's public which we do the same).
On Jul 11, 2016 04:20, "Mat MacAulay"<EMAIL_ADDRESS>wrote:
We noticed the same issue.
Reviewing the logs on the host server looks like it was being used as part
of a DDoS attack.
Indeed the malware installed seems to be used exclusively for DDoS.
"Portbet" - md5sum 98eb47a21ffeb1ed1966f89375e843c3 this is different to
the one John-Lin posted.
The attacker seems to have been able to connect to the host from the docker
container, we are going to look at namespaces to avoid giving root to
compromised containers in the future. There was a good presentation about
namespaces at BSides London a few feeks back:
https://www.youtube.com/watch?v=uQigvjSXMLw
The attacker has tried to cover their tracks by deleting files and logs,
luckily the diskspace had not been overwritten so I could recover the files
to try and workout what they were up to.
The attacker also seems to have created a local account and home dir which
contained the malware.
At the moment we are assuming a vulnerability exists within the shipyard
container, but as yet I have not identified it. Anyone else had any luck
identifying the route in?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/shipyard/shipyard/issues/835#issuecomment-231696726,
or mute the thread
https://github.com/notifications/unsubscribe/AAP6IrxYjcGsBdPIo1RXYTsge8A27cEsks5qUhj1gaJpZM4I-ZeA
.

Our server has been DDOS attacked twice, because of shipyard. 😭


bad results

When I use your demo picture for test ,the results are good.But,when I use my own pictures,the resutls are bad.I find the back images are error.How can I improve the performance.Thank you!

Hi, this might be the problem of failed body fitting.
The default parameters are just used for dataset evaluation. Since there is no parameters that perfectly fit every image, you need to try and play with these parameters in fit.py
Also refer to #10
Also, our method doesn't tackle self-occlusion or difficult poses. Generating textures for these cases is still challenging.

Hi, this might be the problem of failed body fitting. The default parameters are just used for dataset evaluation. Since there is no parameters that perfectly fit every image, you need to try and play with these parameters in fit.py
Also refer to #10
Also, our method doesn't tackle self-occlusion or difficult poses. Generating textures for these cases is still challenging.

Thank you for your reply!I'll try it.


DRY - only call get_organ_types() once

Currently each call to generate_display_subtype() method further calls this get_organ_types() against UBKG ontology-api to retrieve the static/fixed organ info. Move get_organ_types() to the initialization phase as a one-time data fetch and reuse the result in all the iterations of generating display_subtype.

@yuanzhou The solution in https://github.com/hubmapconsortium/search-api/pull/845 would currently require a restart of search-api if UBKG were updated with new organs.
Also, a card similar to this should be written for entity-api, which does the same thing in more places.
https://github.com/hubmapconsortium/entity-api/blob/5cd1c77504e12c26b0592b3b088252ceb6a64e09/src/schema/schema_triggers.py#L1019
https://github.com/hubmapconsortium/entity-api/blob/5cd1c77504e12c26b0592b3b088252ceb6a64e09/src/app.py#L3131
https://github.com/hubmapconsortium/entity-api/blob/5cd1c77504e12c26b0592b3b088252ceb6a64e09/src/app.py#L3403
https://github.com/hubmapconsortium/entity-api/blob/5cd1c77504e12c26b0592b3b088252ceb6a64e09/src/app.py#L3694
https://github.com/hubmapconsortium/entity-api/blob/5cd1c77504e12c26b0592b3b088252ceb6a64e09/src/app.py#L3792
https://github.com/hubmapconsortium/entity-api/blob/5cd1c77504e12c26b0592b3b088252ceb6a64e09/src/app.py#L5208

@kburke thanks for noticing the need of restarting search-api container, the same applies to entity-api when UBKG updates the organs. Normally I handle that during the redeployments.
Yes, the entity-api retrieves the organs from UBKG ontology-api in a similar fashion. It caches the result and normally only individual calls get made. So performance need is not as obvious as in search-api with a lot more requests being made. I'll add a new card to consolidate those calls in entity-api and we can address that later when things slow down a bit. Thanks for pointing that out.

I'm not sure of the point of the /samples/prov-info endpoint, but I'm certainly watching its calls to validate_organ_code() call ontology-api repeatedly, seemingly without caching.
Flipping to load on initialization, and using that value everywhere needed should cover that, but maybe we want to double-check usage of cached values in some way?