ZOS SAL: node.public_address can return wrong ip if support flag is enabled

When the public_address method has been written we used to only ever have one single zerotier interface on the host and we use the ip of this interface to fill the public_address of the node:
https://github.com/threefoldtech/jumpscale_lib/blob/89acbbd28694ea1a576bc7a7783fd8ef4804dc41/JumpscaleLib/sal_zos/node/Node.py#L105-L112
Now that we have the support flag that also create a zerotier interface at boot. This code is non deterministic and can return the support ip or the management ip.
I propose we change the code to:

exclude the range of the support network (<IP_ADDRESS>/16) from the public_address property code
add another property support_address to the Node class and return the ip of the support zerotier interface if any
add a management_address that will just return the same ip as the public address. This is to start  migration from public_address to management_address in the code. cause public address is not really a proper name for it.

support=ztid as kernel parameter would be even better, as different groups might want to define their own support

support=ztid as kernel parameter would be even better, as different groups might want to define their own support

this is out of scope for this issue. If you want that feature create an issue on https://github.com/threefoldtech/0-core/issues

@BolaNasr let's try to get this out of the way today please. Thx

very nice, thanks @BolaNasr


Could not pass event BuildPermissionEvent

[10:20:23] [Server thread/ERROR]: Could not pass event BuildPermissionEvent to MoneyFromMobs v4.6 java.lang.ClassCastException: null

Hey, can you find the full error message because I don't use the BuildPermissionEvent anywhere in the code so I have no idea what it coud be


Close #142 | Merge multilingual CC100 dataloaders (ind, jav, sun) into a single unified dataloader

Accepted config names: cc100_{lang}_{schema} by specifying lang with one of {"ind", "jav", "sun"} and "schema" with either "source" or "nusantara_ssp". If the name is not specified, it will fallback to cc100_jav_source as the _DEFAULT_CONFIG_NAME.
If you want to run the unit test, add --subset_id cc100_{lang} at the end of the command. Example:
python -m tests.test_nusantara nusantara/nusa_datasets/$1/$1.py --subset_id cc100_jav

Example of how to load:
from datasets import load_dataset
dataset = load_dataset("nusantara/nusa_datasets/cc100/cc100.py", name="cc100_sun_nusantara_ssp")
print(data["train"][0])

Please name your PR after the issue it closes. You can use the following line: "Closes #ISSUE-NUMBER" where you replace the ISSUE-NUMBER with the one corresponding to your dataset.
Checkbox

[x] Confirm that this PR is linked to the dataset issue.
[x] Create the dataloader script nusantara/nusa_datasets/my_dataset/my_dataset.py (please use only lowercase and underscore for dataset naming).
[x] Provide values for the _CITATION, _DATASETNAME, _DESCRIPTION, _HOMEPAGE, _LICENSE, _URLs, _SUPPORTED_TASKS, _SOURCE_VERSION, and _NUSANTARA_VERSION variables.
[x] Implement _info(), _split_generators() and _generate_examples() in dataloader script.
[x] Make sure that the BUILDER_CONFIGS class attribute is a list with at least one NusantaraConfig for the source schema and one for a nusantara schema.
[x] Confirm dataloader script works with datasets.load_dataset function.
[x] Confirm that your dataloader script passes the test suite run with python -m tests.test_nusantara --path=nusantara/nusa_datasets/my_dataset/my_dataset.py.
[ ] If my dataset is local, I have provided an output of the unit-tests in the PR (please copy paste). This is OPTIONAL for public datasets, as we can test these without access to the data files.

I think this is a much more scalable approach to loaders with multiple language subsets!  If this approach is adopted, should the dataloader README be updated with the new pattern?
Also, Sam asked me to add sample schema files for id.  If this is submitted, I'll go ahead and do that after you submit this.

@fozziethebeat Hi Keith! :smile: Yeah, we decided to merge the multilingual subsets to a single dataloader. I think @SamuelCahyawijaya already explained it on your PR. It would be great if you could add the sample schemas to this loader.
For the README, maybe we can leave it as-is for now and come back later to edit it, as it's not the current priority, unless you could help us with it. :wink: I'd appreciate it a lot.

Merging this one since it is needed for the other related PR for the sample schema.


[import/order] Sort by nearest parent

I've noticed in my project that alphabetize "asc" arranges parent directory imports in what I would consider a descending order due to the . character being evaluated as less than letter characters, resulting in an order like this:
import A from "../../../a"
import B from "../../b"
import C from "../c"
whereas this makes more sense:
import C from ".../c"
import B from "../../b"
import A from "../../../a"
I recognize that changing something like this is potentially problematic for some people, but if there's interest I would be more than happy to put up a PR to allow us to opt into sorting by nearest parent.
Here's a ts-playground with an approximation of the current and proposed behavior: link

Why does that make more sense?
Imports are usually ordered so that third-party packages are at the top - the farthest ones away - and relative files in the same directory, the closest ones, are at the bottom. Thus, the top order makes the most sense to me.

FWIW, ruff gives the option to go in either direction since it's largely an aesthetic difference.

I'm not opposed to an option, but I definitely think the current behavior makes the most sense and fail to see a logical argument for the other.

The honest answer is because our human brains prefer to see pyramids than upside-down pyramids 🤷♂

If that were true people would be asking for an ordering option where everything's based on line length :-p


The content of the successful QR code cannot be scanned using the scan plugin

Hello, after I use embeddedImage to overlay the center image (the image size is 80*80, and the size of the QR code is 300), I cannot scan the content of the QR code successfully using the scan plugin.
code:
import 'package:hongli/base_common/base_core.dart';
import 'package:hongli/base_common/get_core.dart';
import 'package:mrk_shopping_mall/res/strings.dart';
import 'package:flutter/widgets.dart';
import 'package:qr_flutter/qr_flutter.dart';
class QrWidget extends StatelessWidget {
final String data;
final double size;
//中心图片来源，true为网络，false为本地资源
final bool? fromUrl;
//中间图片
final String? url;
//中间图片的尺寸
final Size? imageSize;
const QrWidget(
{Key? key,
required this.data,
required this.size, this.fromUrl,
this.url, this.imageSize=const Size(60,60)})
: super(key: key);
@override
Widget build(BuildContext context) {
return url != null&&url!.isNotEmpty?(
fromUrl??false?QrImage(
data: data,
version: QrVersions.auto,
size: size,
gapless: false,
errorStateBuilder: (cxt, err) {
return errorBuild();
},
embeddedImage:
NetworkImage(url!),
embeddedImageStyle: QrEmbeddedImageStyle(size: imageSize),
):QrImage(
data: data,
version: QrVersions.auto,
size: size,
gapless: false,
errorStateBuilder: (cxt, err) {
return errorBuild();
},
embeddedImage:
AssetImage(ImageUtils.getImagePath(url!)),
embeddedImageStyle: QrEmbeddedImageStyle(size: imageSize),
)
):QrImage(
data: data,
version: QrVersions.auto,
size: size,
gapless: false,
errorStateBuilder: (cxt, err) {
return errorBuild();
},
);
}
Widget errorBuild(){
return Center(
child: Text(
Ids.qrShowErrorText.tr,
textAlign: TextAlign.center,
),
);
}
}

This has nothing to do with the library is is related to how you're generating the QR code. You should try to use a higher QR code version or a higher level of error correction if you're obscuring a larger portion of the QR code with an image.


The Craft of Programming

http://www.cs.cmu.edu/~jcr/craftprog.html

sorry the links there not work(almost in my side)


 It's jquery related. What is ETA till js is rewriten and you get rid of e.g. jquery UI?

Fixed by https://github.com/cscart/cscart-boilerplate/commit/3373d802c6ffa6a5b15af44e4bffa7a9bee5c885


Add chain confirmations for keygen and signing

Closes: #603
This pull request introduces chain confirmations for keygen and signing. This allows confirming the public key or signature have actually reached the chain so the client can retry in case of failure. This change should also help in the case of small chain reorgs.

Scenarios tested:

happy path, everyone submits public key and signature on time, no transactions are dropped
signature transactions are dropped from all three clients during the first broadcast attempt
public key transaction from one of the clients is dropped during the first broadcast attempt

In all those cases clients were able to retry as advertised and confirm transactions on-chain after 12 blocks.


Is there any detailed usage documentation?

What exactly do you need besides from the README, so I can add it?

What exactly do you need besides from the README, so I can add it?
I want to know how to use delay queue，I checked the source code and it seems that it is not supported


TransactionScope fails with IdentityContext with Timeout.

Running a transaction that executes IdentityContext operations fails with time out.
Seems like the serialized strategy of TransactionScope performes to many locks on the database.
We must find a way to inject the transaction in the Contexts of EntityFramework.

We should be able to create a contract which will serve as a mediator between ORMs and framework.

Opened PR: https://github.com/NerdsComputing/DeepTransaction/pull/6


next appbar v3 conventions

Linked Issue
Closes #2712
Description
Note: I noticed we have "use client" on top of the component definition, I am not sure if this is what caused the issue in next.js but removing it still works so I removed it.

Thanks @Mahmoud-zino. Don't worry about the use client, we'll adjust that for all components if it needs to change.

@Mahmoud-zino this looks and feels worlds better, thank you for the quick turn around. I'll merge and this will be part of our next release.


How to increase root disk size (BOSH VMware vSphere deployment)

Hey There,
The default root disk size, which is 3 Gb is not sufficient, it's getting filled-up while concourse pipeline downloading some blobstore in tmp directory. We followed the bellow steps for increasing the root partition as 10 Gb but there is no result.
Steps Followed:

Extracted "https://bosh.io/d/stemcells/bosh-vsphere-esxi-ubuntu-xenial-go_agent?v=621.77"
Altered disk size as 10240 in stemcell.MF
tarred again
Deleted the existing stemcell and uploaded the modified one.
Recreated a bosh instance (root disk size is still 3 Gb)
:(
further, we did repack-stemcell (changing disk size and version number) & uploaded the stemcell and recreated the bosh instance(with new version of stemcell) still we are blocked, no result at all.

Thanks,
Rajat.

@Nayak2020 Hello. Cant u just use cloud_properties on vm type to specify the root disk ? see https://bosh.io/docs/vsphere-cpi/#resource-pools

Hey @poblin-orange the disk size we define in cloud config, will create a separate EBS volume. It will not increase root partition. Anyway our Engineer team has solved the issue, previously our code was exporting some files under /tmp which was consuming root partition. Now they have exporting in different location under/var/vcap/

Notice you can alors change robot  disk size with cloud config vm type.

On a side note: /tmp is not on the root disk. BOSH mounts a folder of the ephemeral disk under /tmp after the agent started up. If I understand your issue correctly, a bigger ephemeral disk should do the trick. If you're really running our of root disk space, the culprit might be found elsewhere, but not in /tmp.


Automated CoC and Contributing.md updates

Fixes: #44
This PR adds weallbehave and weallcontribute as devdeps, so we can centralize maintenance of these deps, and easily update them as needed, rather than duplicate efforts between multiple repos.
No tests for this one, cause it's just a docs update in the end.

Coverage remained the same at 88.03% when pulling 9643ad3616f6abf0f4d6eec1a9e77a4ff3dfe196 on zkat/coc-and-contrib into 76951ef1f9ae1e840d991ad5130048af223d3638 on latest.

Coverage remained the same at 88.03% when pulling 96f10c73d09d16bda13f147c1a53c2f8078af940 on zkat/coc-and-contrib into 76951ef1f9ae1e840d991ad5130048af223d3638 on latest.

Coverage remained the same at 88.03% when pulling 2548cd1c9e9a0b0b5a68874060a09d823d199911 on zkat/coc-and-contrib into 76951ef1f9ae1e840d991ad5130048af223d3638 on latest.

Coverage remained the same at 88.03% when pulling 2548cd1c9e9a0b0b5a68874060a09d823d199911 on zkat/coc-and-contrib into 76951ef1f9ae1e840d991ad5130048af223d3638 on latest.

Coverage remained the same at 88.03% when pulling 2548cd1c9e9a0b0b5a68874060a09d823d199911 on zkat/coc-and-contrib into 76951ef1f9ae1e840d991ad5130048af223d3638 on latest.


[REQUEST] Implement bikes allowed in a trip verification

Is your feature request related to a problem? Please describe.
Bike allowance in a trip should be indicated. This is a GTFS rule implemented in Google Python validator as ValidateBikesAllowed.
Describe the solution you'd like
Actual Google GTFS validator behaviour : verifies if bike allowance is set to yes, no or unknown.
https://github.com/google/transitfeed/blob/d727e97cb66ac2ca2d699a382ea1d449ee26c2a1/transitfeed/trip.py#L542
Describe alternatives you've considered
Additional context
Line 200 in Error support priorities https://docs.google.com/spreadsheets/d/1vqe6wq7ctqk1EhYkgtZ0_TbcQ91vccfs2daSjn20BLE/edit#gid=0

Implemented in 40c56bfeb98d0e168b0d7101cb94b439e699231a


WindowsMixedRealitySpatialMeshObserver errors at edit-time in 2019

Overview
At edit-time in Unity 2019, WindowsMixedRealitySpatialMeshObserver throws the following error:

Likely, we should make sure not to try creating and configuring a platform observer when not running.
Unity Editor Version
2019.1.0b3
Mixed Reality Toolkit Release Version
Latest mrtk_development

i'll get on these changes asap. thanks for finding them!

@davidkline-ms  fixed?

Should be fixed via https://github.com/microsoft/MixedRealityToolkit-Unity/pull/5778


nixos/neovim: fix runtime.text

Description of changes
https://github.com/NixOS/nixpkgs/pull/221832#issuecomment-1527412085

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

@Garmelon

In case anybody else stumbles across the same problem as me: The solution is to write the changes in after/ftplugin/markdown.vim, not ftplugin/markdown.vim.


Unable to use ZuulFallbackProvider

Hi,
I was trying to use ZuulFallbackProvider to enable fallback for my ZuulApi Server. But even after make all the changes I keep getting the following exception.
com.netflix.zuul.exception.ZuulException: Forwarding error.....
The source code of the project is located in the following location in GitHub
_https://github.com/saibalghosh1980/MicroServices/tree/master/CTS-MS-Zuul-API-Server_
Please let me know if I am using an incorrect version or if the implementation is incorrect.
I am trying to call a get api under the route sampleapi which I have intentionally put delay in order to get a timeout.
Saibal

Why is this commented out https://github.com/saibalghosh1980/MicroServices/blob/master/CTS-MS-Zuul-API-Server/src/main/java/com/cts/fallback/FDCZuulCustomFallbackProviderConfig.java#L18-L21

Hi ,
I commented them out as it was not  working even with the annotation on. I have put them back again and uploaded the stack trace in the following location.
https://github.com/saibalghosh1980/MicroServices/blob/master/CTS-MS-Zuul-API-Server/StackTrace.txt
Saibal

Any update on the issue guys

no

The stack trace shows a timeout exception.

In FDCZuulCustomFallbackProviderConfig, the route needs to be the serviceId, so:
            public String getRoute() {
                return "SAMPLE-CONFIG-CLIENT";
            }


ToggleActions cannot be constructed manually

[2:47 AM] Shatur: It looks like we forgot to add a constructor for https://docs.rs/leafwing-input-manager/latest/leafwing_input_manager/plugin/struct.ToggleActions.html
How about to have ToggleActions::new() and ToggleActions::disabled()?
ToggleActions in leafwing_input_manager::plugin - Rust
Controls whether or not the ActionState / InputMap pairs of type A are active
[5:18 AM] Alice 🌹: Yes please, and also make the phantom data field pub

Reviewing this, it can actually currently be constructed via Default, which means this isn't a critical bug.
To resolve this, I think we should:

Make the PhantomData field pub.
Add two associated constants, ToggleActions::ENABLED and ToggleActions::DISABLED.

Thanks to @Shatur for spotting this.


HA for neutron

neutron on controllers talk to rabbit via localhost
neutron talks to mysql via haproxy
STONITH on failover
only restart neutron services that really require it.

I'm not able to get failover to work right, I think we need this. Can we get this re-prioritized since this would block the 1.1 release.


fix style based on ember-frost-text updating

#major#
fix style based on frost text updating
change API on-input to onInput

We should wait to merge this till the readme and demo are updated as well so its one major bump.

:+1:


Remove repetitive words

:pushpin: Commit 5c7fbd80f2daeded365a0d6e3d2ffa863f6c5af9 has been approved by epage
It is now in the queue for this repository.

:hourglass: Testing commit 5c7fbd80f2daeded365a0d6e3d2ffa863f6c5af9 with merge 04b6aed4d5a35b36db64e54d431e74b3826e750e...

:sunny: Test successful - checks-actions
Approved by: epage
Pushing 04b6aed4d5a35b36db64e54d431e74b3826e750e to master...


Some edits and tutorial rewrite

Should update the Gitter badge on the tutorial to Slack badge as well

Not in the PR but found instances form a series of step that a request in Getting Started


Upgrade to Elastic Stack 5

It's already using ES 5 : FROM sebp/elk:512

Right. I didn't notice that.
Closing this issue. I'll make a PR with Elastic Stack 5 official images #1


Bug when installing version above 0.0.3

Hi,
have following problem:
`
command: /usr/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-wf63qX/django-clone/setup.py'"'"'; file='"'"'/tmp/pip-install-wf63qX/django-clone/setup.py' fix "'"';f=getattr(tokenize, 'ur "'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base pip-egg-info
cwd: /tmp/pip-install-wf63qX/django-clone/
Complete output (3 lines):moma
Traceback (most recent call last):
File "", line 1, in
IOError: [Errno 2] No such file or directory: '/tmp/pip-install-wf63qX/django-clone/setup.py'
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
WARNING: You are using pip version 19.2.3, however version 19.3.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Service 'cla_test' failed to build: The command '/bin/sh -c pip install -r requirements.txt' returned a non-zero code: 1
`

This should be resolved.
Using django-clone>=0.0.10

And you have released it since 5 minutes :-)

No worries.


100% CPU usage running greeter example?

A user writes:
I was trying out the greeter example in the repository and I
noticed that the server uses 100% CPU after the first request.
This only happens when started with Python 2, and not with
Python 3.

I'm using Python 2.7.13 on Arch Linux, grpc is installed with
pip in a fresh virtualenv. Does anyone experience the same
problem?

Hi, thanks for the response.
I'm using grpcio 1.1.0.
I can reproduce the problem every time by starting greeter_server.py and then greeter_client.py. The client receives the response and terminates, and then the CPU load of the server jumps to 100%. It still responds to requests after that.
Profiling results with yappi:
   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
        1    0.000    0.000   28.673   28.673 threading.py:743(CleanupThread.run)
        1    0.000    0.000   28.673   28.673 _server.py:662(_serve)
        1    0.001    0.001    0.906    0.906 greeter_server.py:30(<module>)
        5    0.004    0.001    0.821    0.164 __init__.py:29(<module>)
        1    0.004    0.004    0.811    0.811 __init__.py:16(<module>)
        2    0.000    0.000    0.596    0.298 __init__.py:3019(_call_aside)
        1    0.000    0.000    0.596    0.596 __init__.py:3036(_initialize_master_working_set)
       40    0.000    0.000    0.591    0.015 __init__.py:682(WorkingSet.add_entry)
       64    0.007    0.000    0.588    0.009 __init__.py:2003(find_on_path)
       30    0.000    0.000    0.563    0.019 __init__.py:1977(_by_version_descending)

Running the server with time for 30 seconds shows that most of the time is spent in kernel space:
9.79s user 18.60s system 93% cpu 30.403 total
It looks like it is spinning on a lock or something while waiting for new events.

I am able to reproduce this problem with Python 2.7. @mehrdada have you yet taken a look?

I did a quick test on macOS/Python2.7 and was unable to observe the behavior. Need to investigate further.

I looked further into the issue and it seems it is fixed in the latest master (86e9f3564a9ab05ac14d81628167bc359ca56694). @alexf91 can you please test to see if you can observe the issue on master?

Yes, master is working fine. Only checked with Python 2.7 though.

@alexf91: thank you for looking. How severely are you affected by this problem?
We believe that a release will be cut from (what today is) master in less than six weeks.

I'm not affected at all. I just started using grpc and can use my own build for development.

I tried Ubuntu 16.04/Python 3.5 as well and the issue does not seem to affect master.

Given what's been said so far, I think the right thing for this bug is to leave it until the 1.2.0 release and then close it. While it's definitely weird we're not currently aware of it being a large problem for anyone. We're curious but finding the root cause would be a big investment into somatic code.

I believe I've run into this issue when attempting to port a small system to gRPC, which is going to prevent me from making further progress on that. Any other info on an ETA for a patched stable release?

1.2.0 ought to be released in about a month now.
On Mon, Feb 27, 2017, 18:59 Scott Bezek<EMAIL_ADDRESS>wrote:

I believe I've run into this issue when attempting to port a small system
to gRPC, which is going to prevent me from making further progress on that.
Any other info on an ETA for a patched stable release?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/grpc/grpc/issues/9688#issuecomment-282927396, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AG8bpi35UnhiPGSDsvcwuWt6q0Ep4cwWks5rg413gaJpZM4L_mV_
.

the same problem: run in docker with centos, python 2.7, pip installed grpcio(1.1.3), not found in grpcio-v0.15. why must use thread pool in grpcio(1.1.3)? why not make it as optional param....  sorry for Chinglish...

@kernelpig: the thread pool was made a required, positional parameter of server construction because we believed that we always wanted applications to have that level of control over how servers serviced concurrent RPCs.

I can reproduce the behaviour with grpcio 1.1.5 on Python 3.6.0 (compiled locally) on Ubuntu 16.04.
Master is not affected.

I have the same problem

@nathanielmanistaatgoogle thank you for your answer

@sofo23 master has solved this problem. I tried it in python 2.7, it's ok.

@kernelpig Thank you for your reply.
I try to install using this command grpcio using this command:
pip install git+git://github.com/grpc/grpc.git@86e9f3564a9ab05ac14d81628167bc359ca56694
Is it the right way to install the master branch? It takes soo much time.

Weirdly, we are seeing this issue on Ubuntu + Python 3.5.2 up to grpc 1.2.0rc2 but 86e9f35 appears to be working great.

@egoldschmidt: if it's happening for you in a reproducible and deterministic way with 1.2.anything we'd love to hear about it in as much detail as you can share.

Call me crazy but I think I have a repro case here: https://github.com/egoldschmidt/go-build-time-test
I threw it together quickly so apologies if I'm missing something!

I'm configmring that I can repro the problem consistently with v1.1.0, v1.1.3, v1.2rc1, v1.2rc2 all installed through pip. I'm running Ubuntu 16.04 and python 2.7.12. As soon as one request completes, a single CPU core maxes out to 100% and stays there until I manually restart the server.

we can still reproduce this with latest grpc release v1.2.0 - sadly keeps us from using grpc in production

Is there something wrong with the wheels on pypi?
I've built the tagged 1.1.0 and 1.2.0 versions, and both work fine. Then I built it from the 1.2.0 source archive on pypi, which also works fine.
The load only goes up when I use the wheels from pypi.

I've been experimenting with this and might have a stack trace that could be helpful.
#0  0x00007f384ffdfaed in poll () at ../sysdeps/unix/syscall-template.S:81 #1  0x00007f384c978526 in pollset_work (exec_ctx=0x7f3849956380, pollset=0x1d48cc0,     worker_hdl=0x7f3849956310, now=..., deadline=...) at src/core/lib/iomgr/ev_poll_posix.c:984 #2  0x00007f384c995369 in grpc_completion_queue_next (cc=0x1d48bd0, deadline=...,     reserved=reserved@entry=0x0) at src/core/lib/surface/completion_queue.c:429 #3  0x00007f384c93bbe1 in __pyx_pf_4grpc_7_cython_6cygrpc_15CompletionQueue_2poll (     __pyx_v_deadline=<optimized out>, __pyx_v_self=0x7f384fd630d0)     at src/python/grpcio/grpc/_cython/cygrpc.c:10417 #4  __pyx_pw_4grpc_7_cython_6cygrpc_15CompletionQueue_3poll (__pyx_v_self=0x7f384fd630d0,     __pyx_args=<optimized out>, __pyx_kwds=<optimized out>)     at src/python/grpcio/grpc/_cython/cygrpc.c:10277 #5  0x00007f3850c9ae8e in _PyCFunction_FastCallDict (func_obj=0x7f384b3edb40,     args=0x7f3844001258, nargs=<optimized out>, kwargs=kwargs@entry=0x0)     at Objects/methodobject.c:231
I think that python executable and grpc executable are waiting on the same semaphore to unlock and it's causing them both to just spin, deadlocked.
`  3    Thread 0x7fded4e59700 (LWP 166) "python" 0x00007fdedb13eaed in poll () at ../sysdeps/unix/syscall-template.S:81
2    Thread 0x7fdecffff700 (LWP 173) "python" sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85

1    Thread 0x7fdedc47a700 (LWP 164) "python" 0x00007fdedb140893 in select () at ../sysdeps/unix/syscall-template.S:81`

Also the packages that are built when you pip install from the source versus when you pip install from pypi are binary different. I can give you a list of files that are different between the two packages if that would help.

When I install the pypi package, src/core/lib/iomgr/ev_poll_posix.c is used by src/core/lib/surface/completion_queue.c, however, when I build src/core/lib/iomgr/ev_poll_linux.c is used. Not sure why or what the difference is yet.

@dgn: on what platform are you working?
@egoldschmidt, @assiotis, @alexf91, @timmyzaid: thank you for digging so deeply into this!

To sum up my results:
manylinux builds have the issue, others don't (at least not on my machine). I've built the current master in the manylinux Docker container, and it also has the issue.
The reason why I did not see this issue with Python 3.6 when I reported this, is because there was no manylinux build for 1.1.0 and Python 3.6, so this was built from the source archive.

I'm not sure what your build system looks like but I wonder if GRPC_POLL_STRATEGY is set on it which is causing the event engine to always be the posix version? Outside of that, I'm pretty sure a debug build can be built with that set to poll to be able to reproduce it from source.

We (mostly @nicolasnoble) think we have a diagnosis and I'd like us to have a fix today-tomorrow-ish. We'll definitely be pushing a patch release once the fix is implemented and integrated.
Again, thank you for your investigations.

Well, we'll have to make sure we fully understand the problem first :-) The diagnosis may sound good, but pinpointing the exact problem and coming with a resolution might be harder.

@nathanielmanistaatgoogle: we installed using the 1.2.0 wheels from PyPI on Centos 7
If I can find the time to build from source, I'll give an update on my findings

@nathanielmanistaatgoogle  I am seeing this issue on Centos 7 Python 2.7.11 , would it be possible share what was the diagnosis of the issue?

same issue on Ubuntu 16.04/Python 3.5.2/install from pip
I run strace on the grpc process and get output like that:
poll([{fd=3, events=POLLIN}, {fd=8, events=POLLIN}, {fd=5, events=POLLIN|POLLOUT}, {fd=11, events=0}], 4, 188) = 1 ([{fd=11, revents=POLLHUP}])
clock_gettime(CLOCK_MONOTONIC, {905930, 24155064}) = 0
poll([{fd=3, events=POLLIN}, {fd=8, events=POLLIN}, {fd=5, events=POLLIN|POLLOUT}, {fd=11, events=0}], 4, 188) = 1 ([{fd=11, revents=POLLHUP}])
clock_gettime(CLOCK_MONOTONIC, {905930, 24206581}) = 0
poll([{fd=3, events=POLLIN}, {fd=8, events=POLLIN}, {fd=5, events=POLLIN|POLLOUT}, {fd=11, events=0}], 4, 188) = 1 ([{fd=11, revents=POLLHUP}])
....

It seems that after a TCP connection is closed, poll will return POLLHUP on that fd.
But grpc will keep polling this fd(closed connection), and always get POLLHUP immediately after poll, and so enter infiniteloop.

@comzyh Your analysis was correct, we were not removing fds that were shutdown from the pollset.
I've created a fix in #10345 and pushed a 1.2.1 release.

I tried 1.2.1 release, it did solved the this issue on a simple echo server.
Cheers.
but when I try 1.2.1 on our production service, CPU 100% happened again.
I run strace again on the thread that cost 100% CPU (by top -H -p <pid> ), the output seems like
poll([{fd=3, events=POLLIN}, {fd=8, events=POLLIN}, {fd=5, events=POLLIN|POLLOUT}, {fd=70, events=0}, {fd=71, events=0}, {fd=73, events=0}, {fd=85, events=0}, {fd=87, events=0}, {fd=88, events=0}, {fd=89, events=0}, {fd=90, events=0}, {fd=91, events=0}, {fd=92, events=0}, {fd=93, events=0}, {fd=94, events=0}, {fd=95, events=0}, {fd=96, events=0}, {fd=97, events=0}, {fd=98, events=0}, {fd=99, events=0}, {fd=100, events=0}, {fd=101, events=0}, {fd=102, events=0}, {fd=103, events=0}, {fd=104, events=0}, {fd=105, events=0}, {fd=106, events=0}, {fd=107, events=0}, {fd=108, events=0}, {fd=109, events=0}, {fd=110, events=0}, {fd=111, events=0}, ...], 775, 71) = 772 ([{fd=70, revents=POLLHUP}, {fd=71, revents=POLLHUP}, {fd=73, revents=POLLHUP}, {fd=85, revents=POLLHUP}, {fd=87, revents=POLLHUP}, {fd=88, revents=POLLHUP}, {fd=89, revents=POLLERR|POLLHUP}, {fd=90, revents=POLLHUP}, {fd=91, revents=POLLHUP}, {fd=92, revents=POLLHUP}, {fd=93, revents=POLLHUP}, {fd=94, revents=POLLHUP}, {fd=95, revents=POLLHUP}, {fd=96, revents=POLLHUP}, {fd=97, revents=POLLHUP}, {fd=98, revents=POLLHUP}, {fd=99, revents=POLLHUP}, {fd=100, revents=POLLHUP}, {fd=101, revents=POLLHUP}, {fd=102, revents=POLLHUP}, {fd=103, revents=POLLHUP}, {fd=104, revents=POLLERR|POLLHUP}, {fd=105, revents=POLLHUP}, {fd=106, revents=POLLHUP}, {fd=107, revents=POLLHUP}, {fd=108, revents=POLLHUP}, {fd=109, revents=POLLHUP}, {fd=110, revents=POLLHUP}, {fd=111, revents=POLLHUP}, ...])

I got POLLHUP issue again.
by the way, as If I force compile with --no-binary when installing grpc, I won't encounter this issue.

pip3 install grpcio==1.2.1 --ignore-installed --no-binary grpcio

As many @spielmannj   mentioned above, install from source code or install with compiling (even on earlier version) can always avoid this issue.
I'm trying further test to make sure whether it's my own fault, or #10345 doesn't totally fix this bug.
Just let you know.

@comzyh as I mentioned earlier when you build and install locally GRPC_POLL_STRATEGY isn't set and so a different polling engine is used than when you install from pip. It still seems like that environment variable is set on the build servers which forces it to always use the posix polling engine.
Additionally, @kpayson64, I'm also still seeing the issue on some of my calls but not others. Trying to narrow down the difference.

@nathanielmanistaatgoogle any updates? I'm pretty sure this should be re-opened.

Reopening; @kpayson64 is actively working on this issue.
The problem has turned out to be more subtle than we first anticipated and the scope of fix we're looking at making is looking more appropriate to a minor version release than a point release, so right now we're aspiring for this to be fixed in 1.3.0 (mid-to-late April).

@timburks yes, days ago, I tried to attach grpc thread with GDB, and found that it's calling poll from ev_poll_posix.c rather than ev_epoll_linux.c. I know why now, thank you.

Any updates here?

Hello!
Same problem to me.
Any updates?
Thanks!

For people still experiencing this issue post 1.2.1, are you able to provide a simple reproduction case?

same issue on CentOS 6.5 / Python 3.5.2 / grpcio 1.3.0 installed by pip3.
The result of analysis as same as @comzyh did.
Reproduction:
One of multiple clients close the connection and they're calling a response-streaming API like:
rpc MyLongStreamingAPI(UserInfo) returns(stream UserStatus) {}

still seeing this on ubuntu16, grpcio==1.3.0
it happens unpredictably.
I have multiple golang grpc client create a new connection to python grpc server and close connection when job is done.

You guys realize we're all pinned at 1.0.4 until this is fixed? And that it makes recommending grpc extremely difficult? The last real update was that you guys had a strategy for fixing it, does that still hold? I've put off trying to look at it more myself since it was implied that you were close to a fix.

When there is a call that creates the issue, poll ends up spinning on a locked socket that isn't getting destroyed in chttp2_transport.c::destructive_reclaimer_locked because it still has references. grpc_chttp2_ref_transport and grpc_chttp2_unref_transport are called the same number of times for good and bad calls so there is something else that is messing with the reference count, trying to track that down.

There's some sort of reference cycle, forcing the garbage collector to collect using collect() after event = None fixes the problem.

The code as is relies on python cleaning up the objects. In the case of a reference cycle, the objects won't be deleted until the garbage collector runs, which is non-deterministic. To insure proper destruction of objects, the python logic needs to be restructured to explicitly clean up objects instead of relying on cascading deletes. https://stackoverflow.com/questions/15974561/i-cant-get-dealloc-be-called-when-deleting-an-object sheds some light on what I'm thinking causes the problem.

Of course you could try to figure out what is causing the reference cycle as the GC is only needed when there are cycles, but there is no obvious one and there are a number of references so it would be difficult to track down.
As an aside, having event = None really just masks the real problem. It amounts to tricking python into deleting the object when the real problem is that proper clean up of request_call isn't happening, resulting in the port hanging open.

Can confirm seeing this with 1.4.0 release.
Also happened with the solution @comzyh proposed.
pip install grpcio==1.4.0 --ignore-installed --no-binary grpcio

We'll have to put resource limits on these processes.
Bleeding close to 25 usd a month on every gRPC process isn't fun...

Still seeing this. Any update on status? I'm kind of shocked such a serious issue has been outstanding for so long.

Ruby got a fix for a similar sounding issue... https://github.com/grpc/grpc/pull/11764

We are seeing 100%CPU issue on 1.3.0. Any workaround on this except for reverting back to 1.0.4?

@criver I was able to workaround this by using:
pip3 install grpcio --ignore-installed --no-binary grpcio

@chenditc The workaround works for us. Thanks.

The same problem on GRPC-JAVA V1.6.1 on MacOS. I am debugging my IDEA plugin , the plugin will retrieve images' meta data  and then access the image with http.  below list the resouces usages under several scenarios :-
CPU             Memory        Threads          GRPC         HTTP
0.3 ~2.7       658M               39                   W/O           W/O
2.2 ~ 12.8    659M               40                   W/O           W/
74.5 ~ 279   1.55G              50~60              W/             W/
If I turn on GRPC feature, Intellij IDEA slow down dramatically, GRPC consumes too much CPU & RAM.

I've attempted an alternate fix and released a 1.6.3 patch release.  If this is still an issue, please reopen.

We have update grpc to 1.6.3. But i think some problems still exists.
We have 3 grpc instances.
 I think maybe some data race problem here in grpc c-core?

ping @kpayson64

@ccl0326
There isn't enough information here to conclude that this is the same as the issue that was initially reported.  Does the CPU reach 100% on the bad instance even when you stop serving traffic from it?

@kpayson64
You'r right. I will open a new issue for it.

I'm still seeing this on 1.7.0. Bad thread is using 100% CPU even after stopping serving traffic. Running strace on that particular thread shows the same output as comzyh was getting here.

@kpayson64 this is definitely still happening in 1.7.0 ^

I'm still seeing this on 1.8.0, centos7.3  python 2.7.13

I'm going to try another fix for the upcoming 1.8 release happening later this month.


Support new hf.co/ format

This new format for hf has been implemented by Ollama.

This doesn't work that well, but this is up for grabs if someone can figure it out

Any update on this?

@ericcurtin @swarajpande5 Should this close?

Closing...


Simplify the test sets to verify new gh secrets

This PR is only for verification of terraform-managed GitHub action secrets.
PLEASE, DO NOT MERGE

Closing after successful CI run


feature request

I would like access to the intecom methods such as 'open'
Can you expose those please?
https://developers.intercom.com/installing-intercom/docs/intercom-javascript

Also your github Sponser option doesn't seem to be working.

Yep I have to do a bunch of stuff to make it work :)
I'll expose the methods asap - I also require these :)

haha, thanks @antony

@JeffWScott give that a go :)
Github sponsors accepted me - but now have to approve my profile! Getting paid is hard huh? :D


Fixed bug in config.secret_key code in devise.rb

The <% tags are not needed, and would cause a bug:
/.rvm/gems/ruby-2.0.0-p247/gems/activesupport-3.2.13/lib/active_support/dependencies.rb:245:in `load': /Workspace/projectname/config/initializers/devise.rb:9: syntax error, unexpected '<' (SyntaxError)
<% if rails_4? -%>
^
/projectname/config/initializers/devise.rb:9: syntax error, unexpected tFID, expecting keyword_end
<% if rails_4? -%>
^
Also, rails_4 is in the  devise/lib/generators/devise/install_generator.rb file, which is not automatically included in a project when using the latest devise gem. So people will probably not have this file. Therefore it's better to use Rails::VERSION::MAJOR == 4 directly instead.
PS: I'm on rails 3.2.13 and devise 3.4.1.

There is something definitely weird here. The template is meant to be evaluated inside the generator. So <% should be removed and rails_4 to be available.  How are you getting this error? How can we reproduce it?

If you copy the file from the repo directly to your app you will get this error. You should use the generator instead.

Yeah, I just copied the file from the repo, since I didn't have the latest file in my app, even though I was using the latest devise version. I didn't use any generator to generate that file, since I already had some config from a previous version that I wanted to preserve, so I just manually diffed the files instead. I presume any generator will overwrite previous config?
Maybe this is an issue when upgrading?

We recommend you to use the generator. If you want to copy the file from repository you should make sure you are coping the code that was generated not the template file.

I presume any generator will overwrite previous config?

Yes, it will, but you can do the diff using git and put your old configuration that you still need.

Ok, thanks for the suggestion. You might want to update the docs with this advice, so other people don't unassumingly run into the same problem.

Could you point the doc that advice people to copy the template directly in the application? It should be updated to not give this advice.

No such advise was in the doc. And no advice is given on the procedure to upgrade Devise either. Just for the first install. It seems reasonable that there should be a section about upgrading.


feat(examples): add documentation and walkthroughs for examples

This commit adds documentation along with walkthroughs for how to use jco when building and deploying WebAssembly components.
These examples offer a guide to the components in the repo that mirrors the work in component-docs, but is slightly easier to access and can contain more specific information w/ closer integration to the example code.

Looks great to me - it seems like some of the feedback on the docs PR might also apply here (eg referring to a rev package), let me know when it's ready for final review?
In the mean time I'm working on the CI issues, should have them green shortly.

Thanks @guybedford  :bow: will be happy to have my PR be green!
There was a ton of good feed feedback in the docs PR that I missed, so I'm going to maybe wait for that to land and take another look at this. I'll let you know! Converting to draft for now!

Hey @guybedford this should be ready to review!
In reworking the example tests I found that there's actually been a regression -- I now get this error when running the composed example (it runs in CI on this branch and will run on main so we know earlier next time):
 wasm://wasm/0288e6d6:1
RuntimeError: unreachable
    at wasm://wasm/0288e6d6:wasm-function[127]:0x24d91
    at wasm://wasm/0288e6d6:wasm-function[128]:0x24d9a
    at wasm://wasm/0288e6d6:wasm-function[4927]:0x224065
    at<EMAIL_ADDRESS>(wasm://wasm/0288e6d6:wasm-function[12736]:0x79a5fe)
    at Object.reverseAndUppercase (file:///home/runner/work/jco/jco/examples/components/string-reverse-upper/dist/transpiled/string-reverse-upper.js:58:98)
    at file:///home/runner/work/jco/jco/examples/components/string-reverse-upper/run-transpiled.js:10:30
    ```

Interesting, yeah seems the example is failing. Any ideas?

:man_facepalming:
- reverseAndUppercase()
+ reverseAndUppercase(s)

@guybedford should be ready for review now, thanks for fixing those tests -- everything looks :green_circle:  and now the examples should be covered under test going forward.


Tokenize ghost_internal with axes

Previously two different calls to the map_overlap internal function
ghost_internal would reuse the same keys from the input for
intermediate chunks, even if the depth was different.
Now we properly tokenize based on the axes keyword argument.
Fixes #3634

[ ] Tests added / passed
[ ] Passes flake8 dask

cc @jakirkham

Thanks @mrocklin :)


Package waterfall

In addition to config.yml Waterfall creates a bunch of other configs (like waterfall.yml, modules.yml). You can see them in bin version. Please add them here.

Hm, yes, I forgot about waterfall.yml. But other files are unnecessary, i.e. locations.yml stores locations of players (variable data)


RTGen - Implemented templateType attribute usage for factory functions

Type of change
Please delete options that are not relevant.

[X] New feature (non-breaking change which adds functionality)

Checklist:

[X] Pull request title reflects its content
[X] My code follows the style guidelines of this project
[X] I have performed a self-review of my code
[X] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[X] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

Description:
In RTGen the // [templateType(arg, type)] attribute was already being parsed for factory functions but not given in the type information of the argument objects like it had been done with normal interface function arguments.
Now in createContext(), createLogger() and createMultireader() they are being correctly set in arg.Type.GenericArguments.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


refactor(linter/import): better diagnostic messages for import/no-duplicates

#6694
#6693  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @DonIsaac and the rest of your teammates on  Graphite


Launch error messages are not helpful

For example, if a required sub-schema isn't loaded, like from the classpath, you get a popup like:

That is, the message: debugger daffodil.error.request.
I understand we don't want to directly return stack traces, but we could produce better messages. In this particular case we have the actual error message from Daffodil that is useful:
org.apache.daffodil.debugger.dap.Compiler$CompilationFailed: Schema Definition Error: Error loading schema due to org.xml.sax.SAXParseException; DaffodilXMLLoader: Unable to resolve schemaLocation='com/owlcyberdefense/dfdl/xsd/basicByteBinary.dfdl.xsd'.
Schema context: file:/Users/arosien/nteligen/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Location in file:/Users/arosien/nteligen/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd

Here's an idea: rather than the user having to scroll through the mess of the backend debugger log in the Terminal, we can send the exception message along with the event type back to the extension, which then logs it in a distinct "Daffodil" Output tab:

The user then clicks the "show logs" to switch to that tab:


As an author, I want to feel safe about sharing images and posts with my friends – images should not publicly accessible without authentication.

If the incoming API request doesn't come with an authentication token, do not return an image blob.

This isn't going to be finished for this milestone. I've replaced it with Issue #49 As a server admin, I want to be able add, modify, and remove authors.

Related to #103

@jcairo can this be worked into the serializers as well?

This will be taken care of with a permissions class. It should be the same class as posts for post images. For author images we will have to decide but I assume they could all be public.

Yeah, I guess it will be dependent on how we implement Node authorization.


Why do we have Amp\Future

What's the purpose of Amp\Future? It's documented to be used only in internal code, no public APIs?

Amp\Future is meant to be used inside libraries, i.e. it never should cross public API boundaries, correct.

Why do we have it now? Why not just Deferred as we had previously?

I'm not 100% sure why it's necessary. The only difference is it saving us from a single ->getAwaitable() call. I do not think this is worth it…
But perhaps I'm missing something and @trowski  can tell.

That's exactly why this issue exists.

Future (and Producer for observables) only exists to avoid the function call to retrieve the awaitable (or observable) when the object will never be exposed to a public API. It's a minor performance bump, but if the confusion isn't worth it, Deferred and Postponed can be used instead.

We didn't need it in Amp v1, I don't think we need it in Amp v2. It adds more confusion than a single method call can save us.

Resolved by removal.


Trading question

Hi, I'm using gekko with poloniex and DOGE, CCI indicator with candlesize 1min and historysize 100. I'm not so good on trading, but the backtest for last months is ok. So now the price of doge is 16 or 17 satoshi, not a big deal I know 😃
Btw, this is the result with some hours of gekko:
2017-03-05 08:59:56 (DEBUG):    calculated CCI properties for candle:
2017-03-05 08:59:56 (DEBUG):             Price:                  1.7e-7
2017-03-05 08:59:56 (DEBUG):             CCI tp:         0.00000016
2017-03-05 08:59:56 (DEBUG):             CCI tp/n:       0.00000017
2017-03-05 08:59:56 (DEBUG):             CCI md:         0.00000001
2017-03-05 08:59:56 (DEBUG):             CCI:    -100.33
2017-03-05 08:59:56 (DEBUG):    Trend:  oversold  for  1
2017-03-05 08:59:56 (INFO):     Trader Received advice to go long. Buying  DOGE

2017-03-05 08:59:56 (INFO):     We have new trading advice!
2017-03-05 08:59:56 (INFO):              Position: long
2017-03-05 08:59:56 (INFO):              Market price: 1.6e-7
2017-03-05 08:59:56 (INFO):              Based on market time: 2017-03-05 07:58:00

2017-03-05 08:59:56 (INFO):     (PROFIT REPORT) original simulated balance:      100.00000 BTC
2017-03-05 08:59:56 (INFO):     (PROFIT REPORT) current simulated balance:       99.10270 BTC
2017-03-05 08:59:56 (INFO):     (PROFIT REPORT) simulated profit:                -0.89730 BTC (-0.89730%)
{"status":1,"request":"facd5364fab0bf99751f8ba7fdea5977"}
2017-03-05 08:59:57 (INFO):     Attempting to BUY 15575.058823529413 DOGE at Poloniex
2017-03-05 09:00:16 (DEBUG):    Requested / trade data from Poloniex ...
2017-03-05 09:00:17 (DEBUG):    Processing 1 new trades. From 2017-03-05 07:59:57 UTC to 2017-03-05 07:59:57 UTC. (a few seconds)
2017-03-05 09:00:36 (DEBUG):    Requested / trade data from Poloniex ...
2017-03-05 09:00:37 (DEBUG):    Processing 1 new trades. From 2017-03-05 08:00:21 UTC to 2017-03-05 08:00:21 UTC. (a few seconds)
2017-03-05 09:00:37 (DEBUG):    calculated CCI properties for candle:
2017-03-05 09:00:37 (DEBUG):             Price:                  1.6e-7
2017-03-05 09:00:37 (DEBUG):             CCI tp:         0.00000017
2017-03-05 09:00:37 (DEBUG):             CCI tp/n:       0.00000017
2017-03-05 09:00:37 (DEBUG):             CCI md:         0.00000000
2017-03-05 09:00:37 (DEBUG):             CCI:    -12.33
2017-03-05 09:00:37 (DEBUG):    Trend:  nodirection  for  0
2017-03-05 09:00:37 (INFO):     (PROFIT REPORT) original simulated balance:      100.00000 BTC
2017-03-05 09:00:37 (INFO):     (PROFIT REPORT) current simulated balance:       105.29662 BTC
2017-03-05 09:00:37 (INFO):     (PROFIT REPORT) simulated profit:                5.29662 BTC (5.29662%)
2017-03-05 09:00:56 (DEBUG):    Requested / trade data from Poloniex ...
2017-03-05 09:00:56 (DEBUG):    Processing 1 new trades. From 2017-03-05 08:00:41 UTC to 2017-03-05 08:00:41 UTC. (a few seconds)
2017-03-05 09:00:59 (INFO):     BUY was successfull

And this is what happen on poloniex:
DOGE/BTC	Buy	Exchange	0.00000017	15575.05882352	38.93764706 DOGE (0.25%)	0.00264775 BTC	2017-03-05 07:59:57
DOGE/BTC	Sell	Exchange	0.00000016	16589.89191176	0.00000664 BTC (0.25%)	0.00264774 BTC	2017-03-05 01:02:36
DOGE/BTC	Buy	Exchange	0.00000017	16631.47058823	41.57867647 DOGE (0.25%)	0.00282734 BTC	2017-03-04 22:12:16

As you can see, buy at 16 and sell at 17 😱 not good!!!
Any idea of why? Maybe is my fault?

The idea is that Gekko tries to predict trends (price is going up, or price is going down). You are using the CCI method, which Gekko will use to identify these trends. Gekko will always buy/sell based on the advice, regardless if it is making profit or not.
If you are not understanding why your method is not working for you I'll propose to do a few things:

Read up on how CCI is trying to predict a direction in the market, for example here.
Test CCI over more market data: Gekko allows you to backtest your trading method over a few month of data to simulate what would have happened.
Run Gekko without a real trading but just the simulator (also make sure you configured the simulator so it mimicks your + market  environment).

Feel free to keep the conversation going, but  I'm closing this as I don't see this as an issue with Gekko.

Tnx for you support askmike! Like I said maybe is my problem, I'm pretty new on all this
I used the ui interface to collect 3 months of data from poloniex on btc/doge, so I do a backtest, always on ui interface, with the same value, candle size 1 and history 100 and believe or not, the backtest was good! You can try if you want, here you can see the test of 4 days https://s15.postimg.org/sr7cafy7f/backtest.png
Now I'll read the CCI documentations, but that I don't get is:
Why the backtest say good profit and when I ran the real trade gekko to trade as opposed. You see buy at 17 and sell at 16. Now I read and I try without do real trade, but for me now this remain strange.
Do you have any idea?


fix: get curr bufnr for text_edits

Copied from the body of the commit:

Upstream Neovim now requires the explicit buf number instead of just 0 to indicate the current buffer.

Nice!


Improving CONTRIBUTING.md?

So this project has 3,685 stars, and https://github.com/emmetio/emmet has 2,465 stars - it seems that this is the most popular emmet plugin. Do you think there's room for a high-level architectural overview on how the components fits together and suggestions on how to hack on it?

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

I'm not really using Sublime these days...


[Feature Request] Support for aria-label at the root level of the adaptive-card

Problem Statement
Target Platforms
Web (Javascript)
Host App
Microsoft Search
SDK Version
"adaptivecards": "2.9.0"
Problem
Our search application renders search results using adaptive card layouts. When accessed via keyboard, the expected behavior is for the screen reader to announce the title of the search result. However, due to the lack of support for aria-label or similar properties at the root level, this is not currently possible, making it difficult for users who rely on screen readers.
Test environment
https://searchlayoutdesigner.azurewebsites.net/chooseLayout

Sample template json
{
    "type": "AdaptiveCard",
    "version": "1.3",
    "body": [
        {
            "type": "ColumnSet",
            "columns": [
                {
                    "type": "Column",
                    "width": "auto",
                    "items": [
                        {
                            "type": "Image",
                            "url": "https://searchuxcdn.blob.core.windows.net/designerapp/images/DefaultMRTIcon.png",
                            "size": "small",
                            "horizontalAlignment": "center",
                            "altText": "Result logo"
                        }
                    ],
                    "height": "stretch"
                },
                {
                    "type": "Column",
                    "width": 8,
                    "items": [
                        {
                            "type": "TextBlock",
                            "text": "[${title}](${titleUrl})",
                            "color": "accent",
                            "size": "medium",
                            "weight": "bolder"
                        },
                        {
                            "type": "TextBlock",
                            "text": "**${modifiedBy}** modified {{DATE(${modifiedTime})}}",
                            "spacing": "small",
                            "$when": "${modifiedBy!='' && modifiedTime!=''}"
                        },
                        {
                            "type": "TextBlock",
                            "text": "Modified on {{DATE(${modifiedTime})}}",
                            "spacing": "small",
                            "$when": "${modifiedBy=='' && modifiedTime!=''}"
                        },
                        {
                            "type": "TextBlock",
                            "text": "Modified by __${modifiedBy}__",
                            "spacing": "small",
                            "$when": "${modifiedBy!='' && modifiedTime==''}"
                        },
                        {
                            "type": "TextBlock",
                            "text": "${description}",
                            "wrap": true,
                            "maxLines": 3,
                            "spacing": "medium"
                        }
                    ],
                    "horizontalAlignment": "Center",
                    "spacing": "medium"
                },
                {
                    "type": "Column",
                    "width": 2,
                    "items": [
                        {
                            "type": "Image",
                            "url": "${imageUrl}",
                            "altText": "Result logo",
                            "size": "medium",
                            "horizontalAlignment": "right"
                        }
                    ],
                    "$when": "${imageUrl != ''}"
                }
            ]
        }
    ],
    "$schema": "http://adaptivecards.io/schemas/adaptive-card.json"
}

Proposed solution
Add support for aria-Label at root level.
Example
{
    "type": "AdaptiveCard",
    "version": "1.3",
    "aria-label": "${title}, by ${author}",
    "body": [
    (...template)
    ],
}

Alternatives or Workarounds
No response

@matthidinger - could you please help us with this?


Integration manager broken

With the 1.6 RC it says: Scalar-web No screen specified

I just tried with Dimension as well: ERROR DOMException: "The operation is insecure."

This and #28 doesn't happen for me in a new profile. Both errors come from code loaded from scalar-vector, which makes this hard to debug in the affected profile.

Turns out this is caused by Firefox's tracking protection. Turning third-party cookie blocking to unvisited third-party is enough to break scalar. (I forgot I had tracking protection turned off on riot.im for the same reason.)

Can confirm, disabling Third-party cookies causes the problem. Thanks for investigating!

With Firefox 76 it's no longer possible to fix the bug by just disabling tracking protection for the WebExtension, it's required to globally allow third-party cookies. This is probably a Firefox bug since it still works on regular websites.

FWIW, seems it's working again with Firefox 76.0.1.


Resolve a caching issue when reusing session descriptions.

Description
This resolves a relatively small issue which would return a cached session description despite it being changed. It can be safely cached for internal usage, but should always be updated when requested.
This solution was proposed by Sean DuBois in the #pion slack channel.

Merged with cad7b6d34e963e1b765a88df7301473b9641adb3


fix(sink): Fix delta lake sink timestamp error

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
fix https://github.com/risingwavelabs/risingwave/issues/13153

Checklist

[ ] I have written necessary rustdoc comments
[ ] I have added necessary unit tests and integration tests
[ ] I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934).
[ ] My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
[ ] All checks passed in ./risedev check (or alias, ./risedev c)
[ ] My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)

[ ] My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

[ ] My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note
If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

LGTM.
BTW, what's the root cause of this bug? Changing the value of timestamp is happening on writing data, but the bug happens on validation.

There are actually two errors: one related to the issue of timestamp digit count during validation, and the other concerning the requirement to input timestamps in numeric format during writing. However, due to previous validation issues, the problem during the writing phase went unnoticed.


Reflection + tag_invoke approach to enable ondemand parsing on simdjson

This leverage the work done by @the-moisrex at https://github.com/simdjson/simdjson/pull/2219
As @lemire noted in the comments of example3.cpp, more changes are needed to make this work for simdjson documents. I plan to take up this work to improve upon this contribution.

I am studying the whole thing.

@lemire I've just re-enabled example 2, using the-moisrex latest changes. Everything works as expected (:
https://github.com/simdjson/simdjson/pull/2228

@FranciscoThiesen Excellent.


Addition of validation per batch

Is there an a possibility to add a validation set to every batch, besides the training and test set? I'm stuck on how to adjust the ClassSplitter class to experiment with adding the validation set.
dataset = omniglot("data", ways=5, shots=5, test_shots=15, meta_train=True, download=True)
dataloader = BatchMetaDataLoader(dataset, batch_size=16, num_workers=4)

for batch in dataloader:
    train_inputs, train_targets = batch["train"]
    val_inputs, val_targets = batch["val"]
    test_inputs, test_targets = batch["test"]

I figured that the proper approach to do is, is by taking some samples from the training set if possible and use it as validation set. As is done in this paper,  ''Neural Voice Cloning with a Few Samples'', https://arxiv.org/abs/1802.06006.


add docker image

Codecov Report

Merging #1061 into master will decrease coverage by 3.53%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1061      +/-   ##
==========================================
- Coverage   53.82%   50.29%   -3.54%
==========================================
  Files         117      117
  Lines        8895     8895
==========================================
- Hits         4788     4474     -314
- Misses       3406     3749     +343
+ Partials      701      672      -29

Impacted Files
Coverage Δ

src/restic/backend/b2/b2.go
0% <0%> (-80.59%)
:arrow_down:

src/restic/backend/swift/swift.go
0% <0%> (-73.69%)
:arrow_down:

src/restic/backend/swift/config.go
36.95% <0%> (-54.35%)
:arrow_down:

src/restic/backend/s3/s3.go
64.75% <0%> (+1.32%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 144b7f3...d702227. Read the comment docs.

Hey, thanks for your contribution. I'm not sure I understand the intention here: What's the use case for such a container? If it's only for building restic, we've already published the Dockerfile for the container we're using to produce the release binaries here: https://github.com/restic/builder

use case for such a container

I want to keep everything as containers, I don't want to install backup software on the docker host. I want to have restic backup volume from other containers.

https://github.com/restic/builder

I didn't saw this one.
btw, there is officially maintained images that have https://hub.docker.com/_/golang/

Isn't it trivial to just write your own?

to not duplicate efforts, make it available easily for mass of users.
which is the point to opensource a backup tool like restic, to not have everyone implement their owns.

Thanks for the explanation. I'll need to look into this, but I think we can publish a docker image.

Merged, thanks!

And I've also pushed the image with restic 0.7.1 (just released) to https://hub.docker.com/r/restic/restic/.


Performance improvement - check file / directory operations' usages

For the portions of OG-USA that are run in in functions called by web frontend, review the usage of temporary / scratch / output directory and file handling to see if some can be avoided in some/all situations, e.g. this from execute.py.
dirs = [saved_moments_dir, ss_dir, tpi_dir]
    for _dir in dirs:
        try:
            print "making dir: ", _dir
            os.makedirs(_dir)
        except OSError as oe:
            pass

@PeterDSteinberg In PR #316, I ran into some issues setting a specific path to an output directory for reform and baseline runs.  I made some changes that worked well enough to run the regression tests.  But, I would appreciate it if you could find some time to review them.  Maybe there's a better way to do this.

Try a boolean to trigger saving pickle files (e.g, save_data).  If False, then don't have tax functions to disk.  Will need to refactor running/reading of tax function pickles to do this.  This boolean will have to work together with run_micro.  E.g., need to think about how run_micro=False and save_data=False would work.  Probably just don't want this combination of parameters to be allowed.
Will restructure OG-USA to make OG-USA class.  This will not be saved to disk by default.

Wait. It seems like anyone running OG-USA locally would want these pickle file saved to disk by default, which allows them to skip a lengthy computation for subsequent runs. It seems to me that the only application for which the default saving option should be false is the web app.

@rickecon That's right.  We just need to create a boolean parameter to handle this.  Making default such that saves files, but web app runs will have the save_data=False.  We just want to avoid paying more for cloud computing.

Closing this issues since OG-USA is not currently being maintained on any web apps.


Setup rspec

FEATURES

Create folder spec
Create models folder with files for testing of user, vehicle, and reservation.
Install gem rspec-rails
Linters fix

Hi 🙋♂,
Good job so far!
You have done well reaching this point of the milestone 🤝 It's time to merge it!

Top highlight 🎯

The Pull Request follows the GitHub Flow ✅
The PR title and description are professional and descriptive ✅
Linters are working properly ✅

Suggested changes

[x] Everything is great!

Optional suggestions
Cheers, and Happy coding!👏👏👏


Replace go get reflex

We do this in make dev-go:
$ go get github.com/cespare/reflex

This causes the go.mod file to change, which we do not want. See golang/go#27643. Is there an alternative approach to installing a tool without changing the dependency graph?

Same with shurcooL/vfsgen. We use it in the build process to embed static files. It pollutes the go.mod and go.sum too.

See golang/go#32504
I tried the tools.go, but for two out of three tools I use I get the following message:
cmd/kertificate/tools.go:7:2: import "github.com/google/addlicense" is a program, not an importable package


Fix Ethereum address tests

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@87d446d). Click here to learn what that means.
The diff coverage is 100%.

@@           Coverage Diff            @@
##             master     #55   +/-   ##
========================================
  Coverage          ?   81.1%
========================================
  Files             ?      73
  Lines             ?    2927
  Branches          ?       0
========================================
  Hits              ?    2374
  Misses            ?     553
  Partials          ?       0

Impacted Files
Coverage Δ

Tests/Ethereum/EthereumAddressTests.swift
100% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 87d446d...e4c0720. Read the comment docs.


Google Meets Background Segmentation Model?

https://github.com/tensorflow/tfjs/issues/4177
Would it be possible to get a .pb of the raw tflite model listed there, assuming it truly is Apache licensed?

I'm just going to do a reverse conversion like the other models in MediaPipe, so I can probably convert it to .pb.

@PINTO0309 that would be a real christmas miracle.

I decided to convert the model while optimizing it, so it will take some time.

Take your time :)

I have generated and committed models for .pb, .tflite float32/float16, INT8, EdgeTPU, TFJS, TF-TRT, CoreML, and OpenVINO IR for testing. However, I was so exhausted that I did not create a test program to test it. I would be very happy if you could test it with your help. :smiley:
https://github.com/PINTO0309/PINTO_model_zoo/tree/master/082_MediaPipe_Meet_Segmentation

I didn’t see the CoreML model: is it somewhere?

I didn’t see the CoreML model: is it somewhere?

@ldenoue
https://github.com/PINTO0309/PINTO_model_zoo/blob/main/082_MediaPipe_Meet_Segmentation/download_full_144x256.sh

@ldenoue
https://github.com/PINTO0309/PINTO_model_zoo/blob/main/082_MediaPipe_Meet_Segmentation/download_full_144x256.sh

@PINTO0309 thanks, I saw it now! It works as is, but I am not able to convert my images to the required input.
So I've tried using coremltools to change the input from float32[1,144,256,3] to an RGB image:
import coremltools.proto.FeatureTypes_pb2 as ft
spec = coremltools.utils.load_spec("model_coreml_float32.mlmodel")
input = spec.description.input[0]
input.type.imageType.colorSpace = ft.ImageFeatureType.RGB
input.type.imageType.height = 144
input.type.imageType.width = 256
coremltools.utils.save_spec(spec, "model_coreml_float32_rgb_input.mlmodel")

Then I get a compilation error in XCode coremlc: error: compiler error:  Espresso exception: "Invalid blob shape": Cannot broadcast blobs
Any idea how to fix this?
Or how could I transform my input image (UIImage or CGImage) into an MLMultiArray required by the mlmodel that you generated?
Really great repo, thanks for sharing all your experiments.
Laurent

@PINTO0309 thanks, I saw it now! It works as is, but I am not able to convert my images to the required input.
So I've tried using coremltools to change the input from float32[1,144,256,3] to an RGB image:
import coremltools.proto.FeatureTypes_pb2 as ft
spec = coremltools.utils.load_spec("model_coreml_float32.mlmodel")
input = spec.description.input[0]
input.type.imageType.colorSpace = ft.ImageFeatureType.RGB
input.type.imageType.height = 144
input.type.imageType.width = 256
coremltools.utils.save_spec(spec, "model_coreml_float32_rgb_input.mlmodel")

Then I get a compilation error in XCode coremlc: error: compiler error:  Espresso exception: "Invalid blob shape": Cannot broadcast blobs
Any idea how to fix this?
Or how could I transform my input image (UIImage or CGImage) into an MLMultiArray required by the mlmodel that you generated?
Really great repo, thanks for sharing all your experiments.
Laurent

@PINTO0309 any idea why CoreML model complains once input is converted to RGB?
I noticed that your CoreML model finishes with AddBroadcastable followed by Deconvolution, but after I used coremltools to change the input into RGB, the exported CoreML model finishes with Deconvolution + AddBroadcastable (reversed).
Any idea on how to make the CoreML work with RGB input/output?


[WIP] Supports PodSecurityContext and Gatling runner container securityContext

Description
Provide a description of what has been changed
Checklist
Please check if applicable

[ ] Tests have been added (if applicable, ie. when operator codes are added or modified)
[ ] Relevant docs have been added or modified (if applicable, ie. when new features are added or current features are modified)

Relevant issue #
https://github.com/st-tech/gatling-operator/issues/117

This is great, I would love to be able to specify the sysctls for the port range!


Fix for issue #61 where unclaimed tokens causes too many renders

Overview
As mentioned in issue #61 users are getting an error when they are trying to claim $BANK.
How to reproduce using any wallet
To do this we need to fake the claim's availability on Goerli. All it takes is a small modification to the roots.json to trick the website claim logic.

Open the roots.json in your code editor.
On lines 152132 and 152143 at the bottom of the file, replace 0xEC3281124d4c2FCA8A88e3076C1E7749CfEcb7F2 with your own wallet address  (see screenshot for the highlighted code).
Save the file.
Startup your local NextJS development server.
Switch your wallet to Goerli.
Open the local dev server in your browser and click "Connect".
This will result in the error mentioned in #61

What caused this
After retracing the render steps of the Wallet Modal, I found out that too many re-renders were occurring in the claimData.forEach loop. It seems obvious now, but adding in a simple conditional was all it took to stop this from happening. You can see this change in the PR.
Retrospective
I figured out how to properly test the logic for all of the claim data, by faking it in the roots.json mentioned above. This still doesn't test the actual contract execution, but it will at least check the "claim available" parts. Of course we should have learned this trick during the development phase, or at least made sure we could fully test claiming.
I shouldn't have missed the unprotected loop using state to trigger re-renders. Part of this code was carried over from the 2nd airdrop, when it was using the previous modal for total amount unclaimed. The previous version could use an unprotected loop because it didn't useState to update the total number. However the new modal uses the state of unclaimedTokens to add the "Unclaimed Tokens Available" message for users, which is why this happened.
Hopefully this fixes it!

Updated pull request
There was no reason to even useState in the first place, the hook was staring me right in the face the whole time. This new version only uses the useUserClaimData hook because that is all that is needed.


Unable to set the Back-end on my laptop

Hi,
I have downloaded the repo but facing problem while setting up the back-end as per the instructions provided in the readme or the YouTube tutorial. Please help me for the same.
Thanks

Could you be more descriptive about what exactly didn't work?

Hi Siddarth I am unable to set-up the backend on my system is it possible if we could connect so that you can help me for the same

I am not the original Author of the codebase. If you can describe what is the error you are running into then I can try to look into it and help you, if not me someone else would. People prefer well descriptive descriptions including What was the issues you run into, what exactly did you do, how can we reproduce the error would help.

Hi Siddarth,
What were the issues you ran into:
While running make command in the backend, it showed an error that the command doesn't exist. We downloaded the equivalent version for make command in windows and try but it is giving a different error. Attaching the screenshot of the same.
What exactly did you do:
We downloaded the code from github into our local windows machine. We've extracted the folder and tried running the commands in readme file in backend and frontend folders.
We haven't made use of Docker containers. We simply ran it on our local windows machine. What are the steps to follow in this way?
how can we reproduce the error:
By running the make run command.
We would like to run this setup in a local "Windows" machine. Is it possible to run it without Docker? If with Docker, could you help us with the basic steps so that we can proceed. We're new to this.

Download docker on your machine and set it up properly by following this 👇
https://docs.docker.com/desktop/install/windows-install/#install-docker-desktop-on-windows
navigate to the location where you downloaded sec-insights
open terminal in that location
navigate to the backend folder
use the command docker-compose up

PS 1: Using docker should take care of the environment.
PS 2: You forgot to attach the image.

Hi Siddarth,
As per the above mentioned steps shared by you, I tried running docker-compose up command, at the end I got an exception saying Database is not up to date and asked to run this command "poetry run alembic upgrade head", but when I tried running this, I got an error saying poetry is not recognized as a command though I installed poetry several times.

Follow this thread. Read through it thoroughly and don't blindly copy paste the commands. https://stackoverflow.com/questions/70003829/poetry-installed-but-poetry-command-not-found
Google well before asking for help.

Hi Siddarth,
Even after giving all the key values in .env file we are getting the error that the values are missing. Please refer the image for reference.

.env file

Can you check if you set the values in .env.development or .env

Hi Siddarth,
It is .env

Did u also run
set -a
source .env

?

Did it work ?

Hi Siddarth,
Even after running the set and source command we are getting the same error of value missing.

Hi Siddarth,
While running make run command we are getting the following errors. Could you please look into it and help me out.
Thanks

Hi Siddarth,
While running make seed_local_db command we are getting the following errors. Could you please look into it and help me out.
Thanks

Hello Shivang, I'm encountering the same error, did you found any workaround to solve this ?


[CodingStandard] add useless @return annotation fixer

Check if Slevomat coding standard does this. On Morcata happend that

Not clear report yet


06b: Use translations in HTML

use cxTranslate pipe in component's templates

Let's use this comment to tag yourself (inform others which part you are working on)
Common components:
*common (header/footer)
*orderSummary
*product
*payment
*address
Features:
*authorization (login/guest login/update forgotten password, register)
*addToCart (without product)
*productList (search/brand/category, without addToCart)
*productDetailst (without addToCart)
*cart (without orderSummary, product)
*order (orders/confirmation, without orderSummary, product)
*checkout (checkout, shipping method, without orderSummary, address, payment, product)
*storeFinder

address-book (without address)


Unexpected change of behavior for sfdx force:apex:test:run --synchronous

sfdx force:apex:test:run --synchronous behaviour
There is an unexpected change of the behaviour of sfdx force:apex:test:run --synchronous, because now returns a new message "Specify a test class or test methods when running tests synchronously".
Steps To Reproduce:
$ sfdx --version
sfdx-cli/7.96.0 linux-x64 node-v15.14.0
$ sfdx force:apex:test:run -l RunLocalTests -y -c -r human
ERROR running force:apex:test:run: Specify a test class or test methods when running tests synchronously

Expected result
For us to run all tests synchronously is important for our continuous integration jobs.
Additional information
SFDX CLI Version(to find the version of the CLI engine run sfdx --version): sfdx-cli/7.96.0
SFDX plugin Version(to find the version of the CLI plugin run sfdx plugins --core)
@oclif/plugin-autocomplete 0.3.0 (core)
@oclif/plugin-commands 1.3.0 (core)
@oclif/plugin-help 3.2.2 (core)
@oclif/plugin-not-found 1.2.4 (core)
@oclif/plugin-plugins 1.10.0 (core)
@oclif/plugin-update 1.4.0-3 (core)
@oclif/plugin-warn-if-update-available 1.7.0 (core)
@oclif/plugin-which 1.0.3 (core)
@salesforce/sfdx-trust 3.6.0 (core)
alias 1.1.9 (core)
auth 1.5.1 (core)
config 1.2.8 (core)
generator 1.1.5 (core)
salesforcedx 51.7.1 (core)
├─ data 0.4.3 (core)
├─ apex 0.1.21 (core)
├─ custom-metadata 1.0.11 (core)
├─ limits 1.0.5 (core)
├─ org 1.6.1 (core)
├─ schema 1.0.5 (core)
├─ templates 51.3.0 (core)
├─ user 1.2.8 (core)
├─ @salesforce/sfdx-plugin-lwc-test 0.1.7 (core)
└─ salesforce-alm 51.6.10 (core)
sfdx-cli 7.96.0 (core)
telemetry 1.1.1 (core)
OS and version:
docker alpine: Linux cc246b97cbac 4.19.121-linuxkit #1 SMP Thu Jan 21 15:36:34 UTC 2021 x86_64 Linux

I confirm I'm experiencing  the same issue

Hi @froucher thanks for reporting this! As part of version 51.7 of the salesforcedx plugin, we released new versions of the sfdx force:apex:test:run & sfdx force:apex:test:report commands. More info here https://developer.salesforce.com/blogs/2021/04/clearer-apex-commands.html. The new version fixed many long standing bugs, which changed the behavior in certain scenarios.
The synchronous flag only supports running tests from a single class - this can be specified using the --classnames parameter or by including test methods via the --tests parameter. In the past, running force:apex:test:run -y did not surface any errors, but behind the scenes, the tests were actually running asynchronously since synchronous test runs only support single test classes. With the new version, we’ve surfaced the error so you also know what’s going on. Hope that helps, let me know if you have any other questions!

Many thanks @AnanyaJha for the information, I have an additional question, about if we are going to have this new behaviour definitely, or will be a new version of the plugin that is going to maintain the synchronous behaviour with all tests.
In our side, that means if we make some workaround to make it work, or if we wait to update the cli in the ci environment.
Thanks for the support.


Mac ProjFS kext: Deny I/O on offline roots, with exceptions, part 2

This is a continuation of the work on issue #182. The remaining operations to block are:

[x] A process attempts to read/execute an empty file in an offline root. The result of the read would be bad data, so failing with denied authorisation is preferable to letting the bad data propagate.
[x] A process attempts to create files or directories in an offline root.

The commits implementing those 2 changes are fairly straightforward, however they did cause some knock-on effects:

During gvfs clone, the git subprocess itself wants to create files/directories in the offline root, so we need it to inherit the parent gvfs process's entitlement to access offline roots. The exception check therefore now walks up the process hierarchy.
One of the functional tests, CheckoutBranchWithOpenHandleBlockingProjectionDeleteAndRepoMetdataUpdate needs to mess with the repo while it's not mounted, so I've registered the test runner for offline I/O for the duration of that test.
To avoid weird edge cases, I've made the offline I/O registration in the native userlib thread-safe and reference counted, so registering multiple times is fine, and we only actually deregister once it's been matched with an equal number of unregister calls.

@pmj getting very very close, lets add some more comments and do the small change for the c# test


Looking for ways to modify timeline localisation (timelineReplace) in user file

Hello, I want to have my custom text modification over the existing localisations and want to save such configurations in my user files. I tried to do it in the same way I do with my custom triggers first, but it does not work.
Options.Triggers.push({
  zoneId: ZoneId.TheRoyalMenagerie,
  timelineReplace: [
    {
      'locale': 'jp',
      'replaceText': {
        'Tidal Wave': 'アムレン',
      },
    },
  ],
});

I found another related issue but the solution seems to be not working.
BTW, editing the bundle js definitely works well but I think users are not supposed to make modifications directly to that file.
Could someone give me suggestions about it? Thanks!

locale is ja not jp

locale is ja not jp

Thanks for pointing that out! I edited my local config file and reloaded it, but it seems that it is still not working and I could not see any of my modifications.
From the log window, I can see log lines for trigger overriding like:
BrowserConsole: Overriding 'General Provoke' from '00-misc/general.js' with '...'
But I didn't find log lines related to localisations being overridden. Is there any way that I can debug and know whether the user config is parsed well?

There are no log lines for this.  You could debug by overriding the test timeline and doing a /countdown 5 in Summerford Farms to see if it works.


First cut of cmd/trie

Part of Issue #179

 if (!storage_trie.key()) {
                        break;

Is it right way to check end of bucket in Silkworm? Not check for "ErrNotFound"?

Yes. This is due to cursor implementation where the seek method returns a std::null_opt on not found error.

I've added a commit for clarity on optionals.
Besides I still see a lot of TODOs on cursors operations.
Dunno if its worth change this to a WIP PR.
But for me code so far is good.

I'm still working on Stage 7: Compute State Root Stage (IntermediateHashes), so there's still a lot of TODOs. However, I'd like to submit smaller PRs if possible, provided they don't break other stuff. I find smaller PRs easier to review, while one can easily get lost with in a gigantic PR :)


server: fix reset sshkey is broken in master/4.16

Description
This PR fixes the issue that reset sshkey is broken in master/4.16 branch.
It is a regression issue of #4819

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[x] BLOCKER
[ ] Critical
[ ] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?

@nvazquez @GutoVeronezi @rhtyd
this is a blocker issue in master branch.

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1063

cc @GutoVeronezi

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1072

@blueorangutan test

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1079

Trillian Build Failed (tid-1859)

@blueorangutan test

@nvazquez a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-1872)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 52611 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1872-kvm-centos7.zip
Smoke tests completed. 90 look OK, 3 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_deploy_vm_start_failure
Error
61.37
test_deploy_vm.py

test_deploy_vm_volume_creation_failure
Error
62.55
test_deploy_vm.py

test_vm_ha
Error
83.99
test_vm_ha.py

test_vm_sync
Error
134.20
test_vm_sync.py

Trillian test result (tid-1872)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 52611 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1872-kvm-centos7.zip
Smoke tests completed. 90 look OK, 3 have errors
Only failed tests results shown below:
Test	Result	Time (s)	Test File
test_deploy_vm_start_failure	Error	61.37	test_deploy_vm.py
test_deploy_vm_volume_creation_failure	Error	62.55	test_deploy_vm.py
test_vm_ha	Error	83.99	test_vm_ha.py
test_vm_sync	Error	134.20	test_vm_sync.py

these errors are same as https://github.com/apache/cloudstack/pull/5339#issuecomment-910028104

@blueorangutan package

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1088

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1108

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian Build Failed (tid-1938)

@blueorangutan test

Trillian test result (tid-1940)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36813 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1940-kvm-centos7.zip
Smoke tests completed. 88 look OK, 1 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_02_list_snapshots_with_removed_data_store
Error
51.45
test_snapshots.py

Trillian test result (tid-1942)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36167 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1942-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Trillian test result (tid-1939)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 69940 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1939-kvm-centos7.zip
Smoke tests completed. 74 look OK, 15 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

ContextSuite context=TestLoadBalance>:setup
Error
0.00
test_loadbalance.py

test_list_clusters_metrics
Error
1511.86
test_metrics_api.py

test_list_vms_metrics
Error
0.19
test_metrics_api.py

ContextSuite context=TestNetworkACL>:setup
Error
0.00
test_network_acl.py

test_delete_account
Error
1511.52
test_network.py

test_delete_network_while_vm_on_it
Error
1.13
test_network.py

test_deploy_vm_l2network
Error
1.12
test_network.py

test_l2network_restart
Error
2.18
test_network.py

ContextSuite context=TestPortForwarding>:setup
Error
3.33
test_network.py

ContextSuite context=TestPublicIP>:setup
Error
0.99
test_network.py

test_reboot_router
Failure
0.04
test_network.py

test_releaseIP
Error
0.48
test_network.py

ContextSuite context=TestRouterRules>:setup
Error
0.53
test_network.py

ContextSuite context=TestAdapterTypeForNic>:setup
Error
0.00
test_nic_adapter_type.py

test_01_invalid_upgrade_kubernetes_cluster
Failure
0.00
test_kubernetes_clusters.py

test_02_deploy_and_upgrade_kubernetes_cluster
Failure
0.00
test_kubernetes_clusters.py

test_03_deploy_and_scale_kubernetes_cluster
Failure
0.00
test_kubernetes_clusters.py

test_04_basic_lifecycle_kubernetes_cluster
Failure
0.00
test_kubernetes_clusters.py

test_05_delete_kubernetes_cluster
Failure
0.00
test_kubernetes_clusters.py

test_06_deploy_invalid_kubernetes_ha_cluster
Failure
0.00
test_kubernetes_clusters.py

test_07_deploy_kubernetes_ha_cluster
Failure
0.00
test_kubernetes_clusters.py

test_08_deploy_and_upgrade_kubernetes_ha_cluster
Failure
0.00
test_kubernetes_clusters.py

test_09_delete_kubernetes_ha_cluster
Failure
0.00
test_kubernetes_clusters.py

test_01_add_delete_kubernetes_supported_version
Error
1802.29
test_kubernetes_supported_versions.py

ContextSuite context=TestListIdsParams>:setup
Error
0.00
test_list_ids_parameter.py

test_nic_secondaryip_add_remove
Error
1511.67
test_multipleips_per_nic.py

ContextSuite context=TestNestedVirtualization>:setup
Error
0.00
test_nested_virtualization.py

ContextSuite context=TestIsolatedNetworksPasswdServer>:setup
Error
0.00
test_password_server.py

ContextSuite context=TestPortForwardingRules>:setup
Error
0.00
test_portforwardingrules.py

ContextSuite context=TestPrivateGwACL>:setup
Error
0.00
test_privategw_acl.py

ContextSuite context=TestProjectSuspendActivate>:setup
Error
1518.22
test_projects.py

test_02_list_snapshots_with_removed_data_store
Error
53.61
test_snapshots.py

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1125

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-1960)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34860 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1960-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Ping @rhtyd @davidjumani @sureshanaparti @shwstppr can you please review?

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1147

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-1979)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33340 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1979-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Trillian test result (tid-1978)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34511 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5390-t1978-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File


Adding JWT middleware

Purpose
Adding a middleware to validate the JWT.

It's not secret, just JWTs used for testing 😞