fix: add commitOp to KeyInfo and refactor tests

- What I did

Add CommitOperation to the KeyInfo that describes the commit operation of the key upon Sync.
Deprecate the OnDone callback in SyncService
Refactor the "atclient_sync_callback_test.dart" in the at_functional_tests to use "expectAsync1" instead of adding delays to assert on the SyncProgress.

- How I did it

Add CommitOperation as an instance variable in the KeyInfo class. Upon sync to remote (or) sync to local, populate the CommitOperation that describes the commit operation performed on the key
In the "atclient_sync_callback_test.dart" functional test, currently we have a delay of 10 seconds for the sync to complete and then to assert the data in the SyncProgress. After 10 Seconds, the sync listener is removed from listening to the sync progress. This is causing the validations to skip. Hence removed 10 seconds delay and added "expectAsync1" which waits until the "onSyncProgressEvent" is triggered once.
Introduce a new class -"FunctionalTestSyncService" in at_functional_tests which when invoked run sync and awaits for sync completion
Removed the usage of onDone callback in at_end2end_tests and at_functional_tests and replaced with SyncProgressListener.
Updated the tests in sync_new_tests.dart to use SyncProgressListener instead of onDone callback to await for sync completion.

- How to verify it

The unit and functional tests to assert different commit operations when sync happens between client and server.

- Description for the changelog

Add CommitOperation (CommitOp.) to the KeyInfo to describe if the key is created/deleted upon sync

@sitaram-kalluri can you merge trunk into this branch and resolve the conflicts please? I'd like to review this and, all being well, get it merged tomorrow. Thanks!

@sitaram-kalluri can you merge trunk into this branch and resolve the conflicts please? I'd like to review this and, all being well, get it merged tomorrow. Thanks!

@gkc: Resolved the merge conflicts.

@sitaram-kalluri I know it's unrelated to your PR, but since an end2end test (bypasscache_test.dart) is frequently failing, please can you figure out whatever timing issue is causing it to fail, and fix it, as part of this PR?

@sitaram-kalluri I know it's unrelated to your PR, but since an end2end test (bypasscache_test.dart) is frequently failing, please can you figure out whatever timing issue is causing it to fail, and fix it, as part of this PR?

Actually, ignore my previous request. Please fix that issue in a separate PR.

@sitaram-kalluri I know it's unrelated to your PR, but since an end2end test (bypasscache_test.dart) is frequently failing, please can you figure out whatever timing issue is causing it to fail, and fix it, as part of this PR?

Actually, ignore my previous request. Please fix that issue in a separate PR, assuming we can get the tests to eventually pass for this PR by re-running the checks. (I'm re-re-running the checks now)

Sure Gary, i will look at the bypasscache_test and fix it.


WixLib doesn't get added to references

The WixLib I'm pulling into my Wix setup project isn't getting added to the setup project's references.  I'm a bit unclear whether I should expect them to be at this point. And if so, what might have gone wrong.

I am seeing the same issue. @tg73 ?


I had to reinstall to get 2.1.2 to work

After updating, I had this error:

After deleting and reinstalling the module, it works, but maybe there needs be some migrations script or something so this doesn't occur for other users.

Just a temporary blip. Foundry doesn't handle retagging very well.


PyMySQL needs Python 3, but 2 is being selected

The mariadb secure-installation  fails at the "remove mariadb test database" task.
TASK [remove mariadb test database] ***************************************************************************
Wednesday 14 April 2021  17:20:58 +0200 (0:00:00.018)       0:01:44.065 *******
fatal: [database.icinga.local]: FAILED! => changed=false
  msg: The PyMySQL (Python 2.7 and Python 3.X) or MySQL-python (Python 2.X) module is required.

This was resolved by changing the beginning of ansible-mariadb/tasks/preparations.yml to set the interpreter to python3
- block:
    - name: ensure the ansible_python_interpreter is set to python3 #changed to python 3
      set_fact:
        ansible_python_interpreter: python3 #changed to python 3
    - name: do facts module to get latest information
      setup:
  # Always...
  # when: (
  #   ansible_os_family | lower == 'redhat' and
  #   ansible_distribution_version | int < 8)

I am using Debian 10.
I would make a pull request but I'm not sure if this is the best place to set the interpreter, so i preferred to open an issue.

Thank you!
I will take a closer look.
The role is currently also rather unusable. :)

I'm currently taking a closer look at the role (also because I want to integrate support for Arch Linux).
In my test environment debain 10 ran without changes.
In my opinion, debian 10 also uses python 3 by default.


Perceived Legitimacy Readiness - Investor Deck

http://aleberrycreative.com/swag/perceived-legitimacy/#PitchTwo
Due 14 June 2016
70% completed
Outstanding items:

ensure it's within 10 - 20 mins
adherence to kawasaki's rules as far as possible
cover all grounds of business plan
tailored to audience: (1) SG investors (2) SV investors

kawasaki rules specific to investor pitches

investor pitch:

title slide - name of org, title/name, contact info. should also cut to the chase and explain what you do "we sell software"
problem - describe the pain you're alleviating
solution - not the place for in-depth explanation. provide gist of how you fix the pain.
business model - explain and drop the name of the organisations that are already using your product or service
underlying magic (secret sauce) - less text and more diagrams, schematics, flowchart, white papers, objective proof of concepts
marketing and sales - explain how you are going to reach your customer and your marketing leverage
competition - provide a complete view of the competitive landscape (too much better than too little)
management team - key players of the management team, advisors, and major investor
financial projections and key metrics - 5 year bottom up forecast - make people also understand the underlying assumptions of your forecast but also the numbers you've fabricated
current status, accomplishments to date, timelines, use of funds - share details of positive momentum and traction

more kawasaki:

talking about size of market

method 1:  every market is going to be at least 50 billion -- peel away the layers of the onion until you arrive at the total addressable market (the true size of the potential market you can go after, not the totality of every nickel that's spent in something related to your product or service) -- shows that you truly understand the makeup of your market
method 2:  catalyse the fantasy -- provide a product / service that is so obviously needed that audience can do the math in their heads

thinking about the right analogy for putting your business -- simple and rugged. not too MBA-broad, but not too techie-nitty-gritty. provide enough detail to prove you can deliver and enough aerial view to prove you have a vision.

after 10-20 pitches, start on a clean slate and re-write the text from scratch. let this version 2.0 reflect the gestalt of what you've learned to date instead of being a patchwork quilt

the art of PWP-ing

use a dark background - communicates seriousness and substance
add your logo to the master page
use common, sans serif fonts
animate your body, not your slides
build bullets (and only one level of bullets)
diagrams & graphs > bullets > text
make printable slides

market sizing will master in financial projections, https://docs.google.com/spreadsheets/d/1w4TTBdP4-SxsGgpHYB_I1_5VyvhIl7BcbXS5m2UVLTE/edit#gid=0

some data points about market size:
http://businessoflawblog.com/2015/01/addressable-us-legal-market/
http://legalexecutiveinstitute.com/the-size-of-the-us-legal-market-shrinking-piece-of-a-bigger-pie-an-lei-graphic/
http://legaltransformationinstitute.com/blog/2014/2/22/make-that-400-billion-for-us
using a couple of fermi approximations we concluded that the corporate contract segment of the worldwide legal market is probably in the range of $160B to $180B.

after running this deck a few times i think it would be good to add two slides

about the R&D relationship with NUS, NTU
about the tech stack vs the legal stack


v1.16.2 (rev 981) services not reachable from outside anymore

After
sudo snap install microk8s --channel=edge --classic
sudo iptables -P FORWARD ACCEPT
microk8s.enable dns ingress registry helm jaeger
microk8s.helm init --override spec.selector.matchLabels.'name'='tiller',spec.selector.matchLabels.'app'='helm' --output yaml | sed 's@apiVersion: extensions/v1beta1@apiVersion: apps/v1@' | microk8s.kubectl apply -f -

microk8s              v1.16.2                     981   edge          canonical*   classic

trying to browse jaeger with https://localhost causes ERR_TIMED_OUT
trying to browse any self-deployed service with https://localhost/<service> causes ERR_TIMED_OUT

inspection-report-20191018_084810.tar.gz

@octopus-prime from the tarball you attached I see the following services hosted in MicroK8s:
NAMESPACE            NAME                                  TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                                  AGE
container-registry   service/registry                      NodePort    <IP_ADDRESS>   <none>        5000:32000/TCP                           12m
default              service/env-mongodb                   ClusterIP   <IP_ADDRESS>    <none>        27017/TCP                                5m2s
default              service/env-postgresql                ClusterIP   <IP_ADDRESS>   <none>        5432/TCP                                 5m2s
default              service/env-postgresql-headless       ClusterIP   None             <none>        5432/TCP                                 5m2s
default              service/jaeger-operator               ClusterIP   <IP_ADDRESS>    <none>        8383/TCP                                 11m
default              service/kubernetes                    ClusterIP   <IP_ADDRESS>     <none>        443/TCP                                  14m
default              service/kunde-service                 ClusterIP   <IP_ADDRESS>    <none>        80/TCP                                   3m9s
default              service/preis-service                 ClusterIP   <IP_ADDRESS>   <none>        80/TCP                                   3m9s
default              service/produkt-service               ClusterIP   <IP_ADDRESS>   <none>        80/TCP                                   3m9s
default              service/rechnung-service              ClusterIP   <IP_ADDRESS>   <none>        80/TCP                                   3m9s
default              service/simplest-agent                ClusterIP   None             <none>        5775/UDP,5778/TCP,6831/UDP,6832/UDP      11m
default              service/simplest-collector            ClusterIP   <IP_ADDRESS>   <none>        9411/TCP,14250/TCP,14267/TCP,14268/TCP   11m
default              service/simplest-collector-headless   ClusterIP   None             <none>        9411/TCP,14250/TCP,14267/TCP,14268/TCP   11m
default              service/simplest-query                ClusterIP   <IP_ADDRESS>   <none>        16686/TCP                                11m
kube-system          service/kube-dns                      ClusterIP   <IP_ADDRESS>    <none>        53/UDP,53/TCP,9153/TCP                   12m
kube-system          service/tiller-deploy                 ClusterIP   <IP_ADDRESS>   <none>        44134/TCP                                5m29s

Your kubernetes node is your host. Therefore on localhost you can find the services exposed with nodeport and in your case there is only the registry listening on port 32000. The rest of the services are available through the ClusterIP. For example on <IP_ADDRESS>:80 you will find preis-service.

hi @ktsakalozos,
all services are exposed by ingress-mappings.
i think the same is true for jaeger.
and all worked fine before rev 981.

I see the ingress controller is crashlooping. What is the output of:
microk8s.kubectl logs -n ingress  pod/nginx-ingress-microk8s-controller-pcn8q
microk8s.kubectl describe -n ingress  pod/nginx-ingress-microk8s-controller-pcn8q

Was ingress enabled correctly? Could you first microk8s.enable dns and after the dns is up try to enable the rest of the addons?
Was it enabled without any issues?

microk8s.kubectl logs -n ingress  pod/nginx-ingress-microk8s-controller-pcn8q

-------------------------------------------------------------------------------
NGINX Ingress controller
  Release:       0.25.1
  Build:         git-5179893a9
  Repository:    https://github.com/kubernetes/ingress-nginx/
  nginx version: openresty/<IP_ADDRESS>

-------------------------------------------------------------------------------

F1018 10:27:35.116751       6 main.go:63] port 80 is already in use. Please check the flag --http-port

microk8s.kubectl describe -n ingress  pod/nginx-ingress-microk8s-controller-pcn8q

Name:         nginx-ingress-microk8s-controller-pcn8q
Namespace:    ingress
Priority:     0
Node:         workstation/<IP_ADDRESS>
Start Time:   Fri, 18 Oct 2019 08:35:47 +0200
Labels:       controller-revision-hash=54b8d96d4
              name=nginx-ingress-microk8s
              pod-template-generation=1
Annotations:  <none>
Status:       Running
IP:           <IP_ADDRESS>
IPs:
  IP:           <IP_ADDRESS>
Controlled By:  DaemonSet/nginx-ingress-microk8s-controller
Containers:
  nginx-ingress-microk8s:
    Container ID:  containerd://dd6823539bed4d3af0bfee7decc8727019d01be3241b09cd3ca87a8a240c3b84
    Image:         quay.io/kubernetes-ingress-controller/nginx-ingress-controller-amd64:0.25.1
    Image ID:      sha256:2b8ed1f2046d4b37c18cca2ecc4f435b6618d2d198c0c8bf617954e863cc5832
    Ports:         80/TCP, 443/TCP
    Host Ports:    80/TCP, 443/TCP
    Args:
      /nginx-ingress-controller
      --configmap=$(POD_NAMESPACE)/nginx-load-balancer-microk8s-conf
      --publish-status-address=<IP_ADDRESS>
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    255
      Started:      Fri, 18 Oct 2019 12:27:35 +0200
      Finished:     Fri, 18 Oct 2019 12:27:35 +0200
    Ready:          False
    Restart Count:  36
    Liveness:       http-get http://:10254/healthz delay=30s timeout=5s period=10s #success=1 #failure=3
    Environment:
      POD_NAME:       nginx-ingress-microk8s-controller-pcn8q (v1:metadata.name)
      POD_NAMESPACE:  ingress (v1:metadata.namespace)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from nginx-ingress-microk8s-serviceaccount-token-qqcbf (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  nginx-ingress-microk8s-serviceaccount-token-qqcbf:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  nginx-ingress-microk8s-serviceaccount-token-qqcbf
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/disk-pressure:NoSchedule
                 node.kubernetes.io/memory-pressure:NoSchedule
                 node.kubernetes.io/network-unavailable:NoSchedule
                 node.kubernetes.io/not-ready:NoExecute
                 node.kubernetes.io/pid-pressure:NoSchedule
                 node.kubernetes.io/unreachable:NoExecute
                 node.kubernetes.io/unschedulable:NoSchedule
Events:
  Type     Reason   Age                    From                  Message
  ----     ------   ----                   ----                  -------
  Warning  BackOff  84m (x712 over 3h54m)  kubelet, workstation  Back-off restarting failed container

Okay.
So microk8s.reset and sudo snap remove microk8s.
But same output for sudo netstat -tulpn | grep :80 :-(
Will restart the system and try again...

Thanks for help!
After reboot and reinstall all works fine now.
Do you have any idea how i can get a more stable microk8s?
Every day i have to reset, reinstall or reboot because microk8s stops working.
Is it the snap? Allmost every day there is out of sudden a new version installed...
Is it the suspend-to-ram when systems goes to sleep?
I dont know...

You are currently following the edge channel. Please look at https://microk8s.io/docs/release-channels to see how channels get updates.
The edge channel get updated a few times per day. The beta channels get updated once a patch release is available from upstream (eg 1.16.3) and will include what the edge channel has at that time. The stable channel gets updated a week after the beta channels.
The 1.16/stable channel is a bit less stable than 1.15/stable because a number of addons are catching up to the 1.16 release.
So the most stable channel I would suggest right now is 1.15/stable.

thanks for suggestions.
i think 1.15/stable does not support helm.
so i will stick with 1.16.
does it make sence to switch to beta instead of edge?

Give 1.15/stable a try, I think it has helm.
Yes, beta is more stable than edge for sure.


Fix/unit

Before:

After:

Codecov Report

Merging #1409 (7b5234e) into master (b7606b6) will decrease coverage by 1.84%.
The diff coverage is n/a.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1409      +/-   ##
==========================================
- Coverage   29.44%   27.59%   -1.85%
==========================================
  Files         128       93      -35
  Lines       10516     9972     -544
  Branches       99        0      -99
==========================================
- Hits         3096     2752     -344
+ Misses       7240     7040     -200
  Partials      180      180

Flag
Coverage Δ

be_unit_test
27.59% <ø> (ø)

e2e_test
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b7606b6...7b5234e. Read the comment docs.


depth_anything.load_state_dict' is not recognized as an internal or external command, operable program or batch file.

Error occurred when executing DepthAnythingPreprocessor:
An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
So I downloaded these three：
depth-anything-large, depth-anything-base, and depth-anything-small.
Where are these three files downloaded and stored?
How upload the folder containing the checkpoints to your remote server？
How load the model locally？

in the file "DepthAnything/checkpoints"
-> There are multiple ways to try and load the different sets, I had problems with several ways that existed. It's hit and miss tbh.
From previous code when I was testing, I believe this works (I changed my code to attempt to get metric depth working, so don't quote me). You may have to go through their different examples and find the one that works for you. Also verify you have all the necessary imports.
 from transformers import AutoImageProcessor, AutoModelForDepthEstimation #--  encoder = 'vits' # can also be 'vitb' or 'vitl'  if encoder == 'vits':      depth_anything = AutoModelForDepthEstimation.from_pretrained("LiheYoung/depth-anything-small-hf")  elif encoder == 'vitb'     depth_anything = AutoModelForDepthEstimation.from_pretrained("LiheYoung/depth-anything-base-hf")  else:  depth_anything = AutoModelForDepthEstimation.from_pretrained("LiheYoung/depth-anything-large-hf")

Where are these three files downloaded and stored?

If you're using the run.py script, it uses huggingface downloads by default, which are stored in a directory like:
(user folder)/.cache/huggingface/hub/models--LiheYoung--depth_anything_vits14
On Windows, (user folder) would be something like: C:\Users\username, on Linux it's /home/username and MacOS is something like: /Users/username
These files are not quite the same as the individual model files you linked to (though they are related).

How upload the folder containing the checkpoints to your remote server？

That depends a lot on how you access the remote server. The huggingface folder contains a bunch of files, so the simplest thing is probably to zip/compress the folder so it's a single file and upload that to the server (then decompress it on the server).

How load the model locally？

If you'd like to use the huggingface loader, you'd first need to run the run.py script with an active internet connect to download the .cache/huggingface/... files. Once you have those, you should be able to run the models without an internet connection.
Alternatively, if you'd like to direct use the model files that you linked. You'd have to adjust the way the model is loaded slightly. There's an explanation on the repo home page, but the basic idea is to replace line 34 of run.py with something like:
from depth_anything.dpt import DPT_DINOv2

# Example to load vit-small from local file
model_file_path = "path/to/file/depth_anything_vits14.pth"
depth_anything = DPT_DINOv2("vits", features=64, out_channels=[48,96,192,384])
depth_anything.load_state_dict(torch.load(model_file_path))
depth_anything.to(DEVICE).eval()

# For vitb or vitl, use:
#depth_anything = DPT_DINOv2("vitb", features=128, out_channels=[96,192,384,768])
#depth_anything = DPT_DINOv2("vitl", features=256, out_channels=[256,512,1024,1024])

Thank @heyoeyo for the clear and detailed explanation! I think the issue has been well addressed. I will close it for now.


SIG to TAG

(noting for passerbys that renaming a repo should not break links)

Wait, how does that work?  Will links in gdocs and elsewhere still work?  @justaugustus

Links to the old repo name are automatically redirected by github

I have wandered through your meeting notes and caused updates. Obviously if you see something broken, tell me.

Also, congrats on the issue/PR mark #100 :)


Remove instructions about IP address on iOS

The documentation was not updated after this change : Implemented automatic IP detection for iOS (8c29a52)
Fixes #8651.

By analyzing the blame information on this pull request, we identified @hramos and @joelcloralt to be potential reviewers.

👍
@facebook-github-bot shipit

Thanks for importing. If you are an FB employee go to Phabricator to review.

The documentation for Using the offline bundle still appears to be incorrect. It references uncommenting a line that does not exist. It would be great if it was updated with the correct way of doing this.

@apearce Thank you for reporting, I'll look into this.


KEP-2170: Generate CRD manifests for v2 CustomResources

What this PR does / why we need it:
I generated CRD manifests for v2 CustomResources because we need CRD manifests in the first implementation PR: https://github.com/kubeflow/training-operator/pull/2236.
Since this PR, the manifests directory looks like the following:
- /
  - /manifests
    - /manifests/base
      - /manifests/base/v1
      - /manifests/base/v2alpha1
    - /manifests/overlays

Additionally, I added some kubebuilder markers to generate CRDs.
Which issue(s) this PR fixes (optional, in Fixes #<issue number>, #<issue number>, ... format, will close the issue(s) when PR gets merged):
Part-of: #2208
Checklist:

[ ] Docs included if any changes are user facing

Pull Request Test Coverage Report for Build<PHONE_NUMBER>3
Details

0 of 0   changed or added relevant lines in 0 files are covered.
6 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-0.02%) to 31.761%

Files with Coverage Reduction
New Missed Lines
%

pkg/controller.v1/mpi/mpijob_controller.go
6
80.67%

Totals

Change from base Build<PHONE_NUMBER>8:
-0.02%

Covered Lines:
3945

Relevant Lines:
12421

💛  - Coveralls

/assign @kubeflow/wg-training-leads

/hold

@tenzen-y What do you think about this structure ?
manifests/v1/base
manifests/v1/overlays
manifests/v2/base
manifests/v2/overlays

Similar to Katib: https://github.com/kubeflow/katib/tree/master/manifests/v1beta1 ?
Also, are we planning to maintain and deploy both CRDs for v2alpha1 and v2beta1 in the future ?

@tenzen-y What do you think about this structure ?
manifests/v1/base
manifests/v1/overlays
manifests/v2/base
manifests/v2/overlays

Similar to Katib: https://github.com/kubeflow/katib/tree/master/manifests/v1beta1 ?
Also, are we planning to maintain and deploy both CRDs for v2alpha1 and v2beta1 in the future ?

I don't think that we should support both v2alpha1 and other v2 versions. So, let's rename v2alpha1 with v2.
For the directory structure, The directory structure looks good to me.
But, I wouldn't modify the overlays directory in this PR.
I believe that we should work on entirely manifests creation and move user facing directory changes (overlays) so that users can easily observe the change of installation way.

I believe that we should work on entirely manifests creation and move user facing directory changes (overlays) so that users can easily observe the change of installation way.

In that case, how are going to support deployment/overlay of v1 and v2 version ?

I believe that we should work on entirely manifests creation and move user facing directory changes (overlays) so that users can easily observe the change of installation way.

In that case, how are going to support deployment/overlay of v1 and v2 version ?

Sorry, I accidentally sent the message on the way...
I meant we want to introduce the directory structure you proposed there:  #2208

I renamed v2alpha1 with v2.

@andreyvelich I updated this PR, PTAL. Thanks.

/hold cancel


Add robot framework test for adding references with DOI

Create test that checks that user can add article with valid DOI
Create test that checks that user can add book with valid DOI
Create test that checks that error message is displayed when DOI is non-existent
Create test that checks that correct error message is displayed when DOI format is invalid

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.


Capturing PMKID not working anymore ?

Hey, I been trying to captures pmkid's for the past 2 days but without any success.
I have routers with wps and WPA/2 - AES enabled and weak password for testing but I'm not able to capture anything. I Tries with multiple version of hxcdumptools but without any success.
Do you have any route on why i can't capture anything?
My setup is a Orangepi 3 LTS with armbian and a ALPHA Network AWUS036ACH. I have attached some screenshot.

hcxdumptool 4.2 is outdated because it depends on WIRELESS EXTENSIONS.
AWUS036ACH is based on RTL8812AU. This driver highly depend on NETLINK.
Please update to latest git head or at least v 6.3.1 (NETLINK version)
More information is here:
https://github.com/ZerBea/hcxdumptool/discussions/343

Hi @ZerBea thanks you for answering me that quickly,
I been trying to use the new version of hcxdumptools too (v6.3.1) but without any success too, maybe you can help me on the command should use ?
Thanks -SCB

Make sure you're running latest driver:
https://github.com/aircrack-ng/rtl8812au
$ hcxdumptool -L

Requesting physical interface capabilities. This may take some time.
Please be patient...

available wlan devices:

phy idx hw-mac       virtual-mac  m ifname           driver (protocol)
---------------------------------------------------------------------------------------------
  0   3 74da380645e7 74da380645e7 + wlp48s0f4u2u4    rtl88XXau (NETLINK)

* active monitor mode available
+ monitor mode available
- no monitor mode available

bye-bye

$ hcxdumptool -I wlp48s0f4u2u4

Requesting physical interface capabilities. This may take some time.
Please be patient...

interface information:

phy idx hw-mac       virtual-mac  m ifname           driver (protocol)
---------------------------------------------------------------------------------------------
  0   3 74da380645e7 74da380645e7 + wlp48s0f4u2u4    rtl88XXau (NETLINK)

available frequencies: frequency [channel] tx-power of Regulatory Domain: DE

  2412 [  1] 20.0 dBm	  2417 [  2] 20.0 dBm	  2422 [  3] 20.0 dBm	  2427 [  4] 20.0 dBm
  2432 [  5] 20.0 dBm	  2437 [  6] 20.0 dBm	  2442 [  7] 20.0 dBm	  2447 [  8] 20.0 dBm
  2452 [  9] 20.0 dBm	  2457 [ 10] 20.0 dBm	  2462 [ 11] 20.0 dBm	  2467 [ 12] 20.0 dBm
  2472 [ 13] 20.0 dBm	  2484 [ 14] 20.0 dBm	  5075 [ 15] 30.0 dBm	  5080 [ 16] 30.0 dBm
  5085 [ 17] 30.0 dBm	  5090 [ 18] 30.0 dBm	  5100 [ 20] 30.0 dBm	  5120 [ 24] 30.0 dBm
  5140 [ 28] 30.0 dBm	  5160 [ 32] 23.0 dBm	  5180 [ 36] 23.0 dBm	  5200 [ 40] 23.0 dBm
  5220 [ 44] 23.0 dBm	  5240 [ 48] 23.0 dBm	  5260 [ 52] 20.0 dBm	  5280 [ 56] 20.0 dBm
  5300 [ 60] 20.0 dBm	  5320 [ 64] 20.0 dBm	  5340 [ 68] 20.0 dBm	  5360 [ 72] 30.0 dBm
  5380 [ 76] 30.0 dBm	  5400 [ 80] 30.0 dBm	  5420 [ 84] 30.0 dBm	  5440 [ 88] 30.0 dBm
  5460 [ 92] 30.0 dBm	  5480 [ 96] 26.0 dBm	  5500 [100] 26.0 dBm	  5520 [104] 26.0 dBm
  5540 [108] 26.0 dBm	  5560 [112] 26.0 dBm	  5580 [116] 26.0 dBm	  5600 [120] 26.0 dBm
  5620 [124] 26.0 dBm	  5640 [128] 26.0 dBm	  5660 [132] 26.0 dBm	  5680 [136] 26.0 dBm
  5700 [140] 26.0 dBm	  5720 [144] 13.0 dBm	  5745 [149] 13.0 dBm	  5765 [153] 13.0 dBm
  5785 [157] 13.0 dBm	  5805 [161] 13.0 dBm	  5825 [165] 13.0 dBm	  5845 [169] 13.0 dBm
  5865 [173] 13.0 dBm	  5885 [177] 30.0 dBm

bye-bye

$ sudo hcxdumptool -i wlp48s0f4u2u4 -F --rds=1
  CHA    LAST   R 1 3 P S    MAC-AP    ESSID (last EAPOL on top)  SCAN-FREQUENCY:   2437
-----------------------------------------------------------------------------------------
 [  6] 23:22:05 + +   + + 5004b81a2fd3 TEST_NETWORK

column P = + means PMKID successful captured.
From --help:
real time display:
 R = + AP display:     AP is in TX range or under attack
 S = + AP display:     AUTHENTICATION KEY MANAGEMENT PSK
 P = + AP display:     got PMKID hashcat / JtR can work on
 1 = + AP display:     got EAPOL M1 (CHALLENGE)
 3 = + AP display:     got EAPOL M1M2M3 (AUTHORIZATION) hashcat / JtR can work on
 E = + CLIENT display: got EAP-START MESSAGE
 2 = + CLIENT display: got EAPOL M1M2 (ROGUE CHALLENGE) hashcat / JtR can work on

$ hcxdumptool -v
hcxdumptool 6.3.1-55-gde8e8b2 (C) 2023 ZeroBeat
compiled by gcc 13.2.1
compiled with Linux API headers 6.4.0
compiled with glibc 2.38

I'm running hcxdumptools now with the following command:
sudo hcxdumptool -i wlp48s0f4u2u4 -F --rds=1 --disable_deauthentication

How long does capturing a pmkid take? I saw people wardriving with hcxdumptool so i just gussed a few secound but i cant get anyphing from 2 routers right now.

It should take less than 5 seconds if the scan reached the AP channel.
Your entire R column is empty.
R = + AP display:     AP is in TX range or under attack
Possible reasons:
Packet injection is not working
AP is not in range.
You are on 5GHZ. hcxdumptool respects the wireless regulatory domain which must not be unset.
The impact of this regulatory domain is huge:
https://github.com/aircrack-ng/aircrack-ng/discussions/2430#discussioncomment-5007839
hcxdumptool will not transmit on prohibited frequencies or if RADAR is detected on this channels.
To find out if PACKET injection is working, run hcxdumptool in active scan mode:
$ sudo hcxdumptool -i interface_name -F --rcascan=active
If packet injection is working as expected and the regulatory domain is correct and the AP is in Range, you should see a + in the A column. If that is not the case, you're running into one of the problems mentioned above.

I executed the command you sent above and i got this as a output, The beacon is increasing but not the reponse. Does that mean my injection is not working ?

If the response time does not increase, the AP does not respond to hcxdumptool requests due to the above mentioned reasons.
I pushed an update to hcxdumptool:
Now RESPONSE column is empty if no response was received.

Please notice that not all Freeboxes transmit a PMKID:
https://wpa-sec.stanev.org/?search=Freebox-

Yes i cheacked that and i saw other freebox was transmitiing pmkid also everyphing inside my config is on and by default and i never touched a fing in the wifi section except the password. I Just ran the new update of hcxdumptool for 5 minute and this is the output i have.

Some do this:
https://wpa-sec.stanev.org/?search=dc00b08b9de0
and some not:
https://wpa-sec.stanev.org/?search=8c97ea90ae00

Is the regulatory domain configured?
$ sudo iw reg get
global
country FR: DFS-ETSI
	(2400 - 2483 @ 40), (N/A, 20), (N/A)
	(5150 - 5250 @ 80), (N/A, 23), (N/A), NO-OUTDOOR, AUTO-BW
	(5250 - 5350 @ 80), (N/A, 20), (0 ms), NO-OUTDOOR, DFS, AUTO-BW
	(5470 - 5725 @ 160), (N/A, 26), (0 ms), DFS
	(5725 - 5875 @ 80), (N/A, 13), (N/A)
	(5945 - 6425 @ 160), (N/A, 23), (N/A), NO-OUTDOOR
	(57000 - 71000 @ 2160), (N/A, 40), (N/A)

yes i cheacked that like 20 minutes ago

It should not be 00 or 99, because hcxdumptool will not transmit on "PASSIVE SCAN only channels" or on DFS channels if a RADAR signal is detected.

How i can change it so i can work with what i got ?

$ sudo iw reg set FR
and to confirm it is correct
$  iw reg get

Still having 99 on my interface

If it is still on 00 (DFS-UNSET) neither crda nor wireless regulatory domain is installed and/or configured.

https://forum.armbian.com/topic/1677-crda-and-wireless-regdb/

I didnt install anyphing except for your insane tools and armbian. Im gonna cheack out https://forum.armbian.com/topic/1677-crda-and-wireless-regdb/ and see if i can fix it

Maybe the link mentioned above is helpful. I don't use armbian.
Runnning Arch Linux or raspbian, crda must be installed and the kernel must be compiled with option to use it.

Does something like this can work if i change the years to 2022 ?
https://gist.github.com/kylemcdonald/b4ef99605fdf32d872dbc72d966421a0

to figure out whether AP cachin is activated or not, capture a 4way handshake between AP and a CLIENT.
Open the dump file by Wireshark.
Apply this filter:
wlan_rsna_eapol.keydes.msgnr == 1
left click on a packet coming from the target AP
AP dos not transmit a PMKID:
WPA Key Data Length: 0
AP transmit a PMKID:
WPA Key Data Length: 22
To check if PMKID is not zeroed left click on WPA Key Data:
Tag: Vendor Specific: Ieee 802.11: RSN PMKID
    Tag Number: Vendor Specific (221)
    Tag length: 20
    OUI: 00:0f:ac (Ieee 802.11)
    Vendor Specific OUI Type: 4
    Data Type: PMKID KDE (4)
    PMKID: should contain a not zeroed PMKID

If the kernel is configured to use crda, it will work.
E.g. on Arch Linux:
$ zcat /proc/config.gz | grep CONFIG_CFG80211
CONFIG_CFG80211=m
# CONFIG_CFG80211_DEVELOPER_WARNINGS is not set
CONFIG_CFG80211_REQUIRE_SIGNED_REGDB=y
CONFIG_CFG80211_USE_KERNEL_REGDB_KEYS=y
CONFIG_CFG80211_DEFAULT_PS=y
CONFIG_CFG80211_DEBUGFS=y
CONFIG_CFG80211_CRDA_SUPPORT=y
CONFIG_CFG80211_WEXT=y
CONFIG_CFG80211_WEXT_EXPORT=y

to figure out whether AP cachin is activated or not, capture a 4way handshake between AP and a CLIENT. Open the dump file by Wireshark. Apply this filter: wlan_rsna_eapol.keydes.msgnr == 1 left click on a packet coming from the target AP
AP dos not transmit a PMKID: WPA Key Data Length: 0
AP transmit a PMKID: WPA Key Data Length: 22
To check if PMKID is not zeroed left click on WPA Key Data:
Tag: Vendor Specific: Ieee 802.11: RSN PMKID
    Tag Number: Vendor Specific (221)
    Tag length: 20
    OUI: 00:0f:ac (Ieee 802.11)
    Vendor Specific OUI Type: 4
    Data Type: PMKID KDE (4)
    PMKID: should contain a not zeroed PMKID

I tried to capture traffic arounf me and reconnect and disconnect multiple time with my phone and i got this output.

and the command i ran is
tcpdump -i wlx00c0cab02c9a -s 65535 -w test.pcapng
and for the crda here the output i get:

First screenshot:
AP doesn't use PMKID caching.
Second screenshot:
crda is supported - you need to install it via your package management system.

The get full capabilites (if crda is installed) set country IN:
$ sudo iw reg set IN
$ sudo iw reg get
global
country IN: DFS-UNSET
	(2402 - 2482 @ 40), (N/A, 30), (N/A)
	(5150 - 5250 @ 80), (N/A, 30), (N/A)
	(5250 - 5350 @ 80), (N/A, 24), (0 ms), DFS
	(5470 - 5725 @ 160), (N/A, 24), (0 ms), DFS
	(5725 - 5875 @ 80), (N/A, 30), (N/A)

There is no need to patch the regulatory domain need third party tools!

The get full capabilites (if crda is installed) set country IN:
$ sudo iw reg set IN
$ iw reg get
global
country IN: DFS-UNSET
	(2402 - 2482 @ 40), (N/A, 30), (N/A)
	(5150 - 5250 @ 80), (N/A, 30), (N/A)
	(5250 - 5350 @ 80), (N/A, 24), (0 ms), DFS
	(5470 - 5725 @ 160), (N/A, 24), (0 ms), DFS
	(5725 - 5875 @ 80), (N/A, 30), (N/A)

There is no need to patch the regulatory domain need third party tools!

I downloaded crda with the external deb package

but without any success on changing the reg to IN

There is no need to run deauthentication attacks. The build in REASSOCIATION attack is working fine to get a 4way handshake.
BTW:
depending on options, hcxdumptool will stop an attack immediately if a PMKID or a 4was handshake was captured.
--attemptclientmax=<digit>     : set maximum of attempts to request an EAPOL M2
                                  default: 10 attempts
                                  to disable CLIENT attacks set 0
--attemptapmax=<digit>         : set maximum of received BEACONs to request a PMKID or to get a 4-way handshake
                                  default: stop after 4 received BEACONs
                                  attemptapmax=0 include this options:
                                   disable_deauthentication: do not transmit DEAUTHENTICATION/DISASSOCIATION frames
                                   disable_proberequest    : do not transmit PROBEREQUEST frames
                                   disable_association     : do not AUTHENTICATE/ASSOCIATE
                                   disable_reassociation   : do not REASSOCIATE a CLIENT

There is no need to run deauthentication attacks. The build in REASSOCIATION attack is working fine to get a 4way handshake.
BTW: Depending on options, hcxdumptool will stop an attack immediately if a PMKID or a 4-way handshake was captured.
--attemptclientmax=<digit>     : set maximum of attempts to request an EAPOL M2
                                  default: 10 attempts
                                  to disable CLIENT attacks set 0
--attemptapmax=<digit>         : set maximum of received BEACONs to request a PMKID or to get a 4-way handshake
                                  default: stop after 4 received BEACONs
                                  attemptapmax=0 include this options:
                                   disable_deauthentication: do not transmit DEAUTHENTICATION/DISASSOCIATION frames
                                   disable_proberequest    : do not transmit PROBEREQUEST frames
                                   disable_association     : do not AUTHENTICATE/ASSOCIATE
                                   disable_reassociation   : do not REASSOCIATE a CLIENT

yes but the REASSOCIATION attack is to force a client to reconnect to the AP and that is not clientless? or i am wrong. I dont see my self waitting for client to reconnect to the AP when warwalking/driving.
if it completly clientless yea that could work i just need to get my dam crda working

Some Linux distributions split the package to crda and wireless-regulatory domain, e.g. Debian:
https://packages.debian.org/search?keywords=regdb&searchon=names&suite=stable&section=all

You're not wrong. Except of the PMKID attack all attacks are not CLIENT less.
But some attacks are AP less  - useful if the target AP is not in RANGE while the CLIENT is in RANGE.
All M1M2ROGUE attacks are valid, because the MESSAGE PAIR is calculated based on the REQUEST of hcxdumptool and the RESPONSE of the CLIENT. That allow hashcat to run with --nonce-error-corrections=0.

You're not wrong. Except of the PMKID attack all attacks are not CLIENT less. But some attacks are AP less - useful if the target AP is not in RANGE while the CLIENT is in RANGE. All M1M2ROGUE attacks are valid, because the MESSAGE PAIR is calculated based on the REQUEST of hcxdumptool and the RESPONSE of the CLIENT. That allow hashcat to run with --nonce-error-corrections=0.

For a wardriving setup i cant see my self asking client to reconnect to there routers. Is this really a good way to capture 4way handshake and how mush time i need to sniff out the info needed ?

I don't want to answer this public. Please send me a PM I can respond to.
You get get the email address directly from git AP:
https://api.github.com/users/ZerBea/events/public

I don't want to answer this public. Please send me a PM I can respond to.
You get get the email address directly via git API: https://api.github.com/users/ZerBea/events/public

done.

Thanks.
Answered via PM (with attached PGP public key).

I think we can close this report here, because hcxdumptool is working as expected.

I think we can close this report here, because hcxdumptool is working as expected.

yes totaly


Project: Bake Grapher style data.json files for most columns in ETL

In 2022 we tried a few ways of serving data from ETL in a way the grapher admin can use it (python api, node api as part of the grapher admin). None of these were really satisfactory.
What we currently do is that we have Grapher steps at the end of etl that upsert etl columns to the grapher database. In this process, rows are created in the datasets, variables and sources tables so that the metadata of these entities is registered in the DB. At the same time, the data values are upserted into the data_values table. This table is by far the largest part of the grapher MySQL DB, blowing a DB that would be a few hundred MB to over 70 GB. In light of the upcoming work on provisioning staging servers it would be very desirable if we could kill data_values for good and make it much faster to get a full copy of our database running in another instance.
To kill data_values, the data for all backported or fully ETL datasets (at the grapher level of ETL processing steps) has to be transformed into data.json files. The point where we know best what needs to be regenerated is the ETL which track this information on a dataset level granularity.
This project is then about creating a new export step that could be part of the ETL but it could also be a separate downstream process, that makes the data of a column available as data.json files and stores them in S3. Every variable (=ETL column) in a dataset in a grapher step would have it's own file.
For the admin, the metadata fetching should still happen as before via the grapher admin api that queries Mysql directly. For baking, the metadata would similarly be consumed from mysql directly.
Open questions:

[ ] Should the S3 bucket be exposed to the public and cached via cloudflare? If no then the baking step would involve copying the data.json files for the used variables to netlify. If yes then we would serve data files from S3 via cloudflare.
[ ] Can we bake Garden level variables as well? And if so do we want to? This is more of a question of what to use for ids in this case (variable ids are only generated in the grapher step) and if we can assemble enough metadata for these variables from the ETL alone and what to do if there is a data model mismatch (i.e. if the ETL Garden variable has more dimensions than year + entity)
[ ] Should separate summary statistics be generated as well? These are currently part of the metadata of a variable but for creating them at baking time would mean that the whole data would have to be fetched again which we'd probably like to avoid. At ETL time we will probably have the data loaded into a pandas dataframe already and can just fetch e.g. the set of entities and the time range.

Let me first review what we've done until now
Hosting static files on S3 instead of Netlify to reduce its bandwidth (and save on Netlify plan)
graph LR

baking --> |sync| S3 -.-> website
baking --> bakedSite/ -.-> website

Once we bake all the static files (.json, .png, .svg), sync them to S3 and remove them from bakedSite/. This makes Netlify builds much smaller and faster to deploy. Then redirect /grapher/data/* to https://catalog.ourworldindata.org/bake/live/grapher/data/ (which is behind CloudFlare so fast).
This is independent on any data_values changes (it could keep loading them from data_values or load them from S3).
Issue: https://github.com/owid/owid-grapher/issues/1707
PR: https://github.com/owid/owid-grapher/pull/1719/files
Creating [variableid].json files in ETL when publishing a dataset
graph LR

etl[ETL] --> |publish| S3[S3 .json] -.-> website

baking --> bakedSite/ -.-> website

In addition to syncing parquet / feather files to S3, we'd also create [variableid].json for every variable and upload it to S3 with proper Content-encoding (gzip?).
We could then remove variables from baking (and S3 sync) and redirect site to our S3 catalog. However, variables baking isn't bottleneck and we might still have to sync other types of files to S3 (.png or .svg) to make it smaller (variables data only make up about 20% of our build size).
Potential issues:

Performance (either creating JSON files or syncing them to S3)
File size (could be ok with good compression)
Even with automatic deploys, there might be delays between merging and file appearing on S3

(We could do this either as part of publishing or as part of upserts to grapher... the latter makes more sense as it reduces delays)
Baking from parquet files instead of data_values
graph LR

etl[ETL] --> |publish| S33[S3 .parquet]

S33 --> baking --> bakedSite/ -.-> website

(This could play well with the hosting static files on S3 during baking)
We've tried it before and parked this because baking from remote catalog was slow (~1h) as there wasn't a good way how to make range requests to S3. That has apparently changed though and Cloudflare R2 has recently added support for both range requests and Global CDN. So if we synced our files also to R2 (which was easy and there's a PR) we could bake from S3 in reasonable time.
An advantage is that we wouldn't have to mess with .json files. On the other hand, R2 is relatively new and we might hit performance issues (or other issues) with it.
Best option?
We were almost there with R2 & parquet & syncing S3 during baking, but there were problems with DuckDB and range requests. These might have been solved by now... Is it worth testing the performance again? Not sure.
On the other hand, [variableid].json approach is easy to implement and is the sure bet unless we run into performance issues. It wouldn't solve the problem with Netlify build size, we'll still have to sync non-data files to S3 during baking. All in all, I think we should go with it and see where it leads us. What do you think @danyx23 ?

@danyx23 would you mind taking a look at my first shot in this PR? If we agree on the general direction I can add tests etc.

Summarising the steps towards the better world without data_values:

[ ] Add dataPath and metadataPath to variables table https://github.com/owid/owid-grapher/pull/1922
[ ] Refactor baking with polars library https://github.com/owid/owid-grapher/pull/1892
[ ] Start syncing data_values and metadata of datasets with at least one chart to S3 https://github.com/owid/etl/pull/778
[ ] Bake using data JSON files instead of data_values https://github.com/owid/owid-grapher/pull/1887
[ ] Sync all datasets to S3
[ ] Prune large datasets that have been synced from data_values
[ ] Migrate all services that use data_values to use S3 files (covid, importers, chart revisions)
[ ] Rip out data_values (or make it small enough so that we can export them as part of MySQL dump)

Here are some places where data_values is used. None of them looks like a major blocker, though updating them to use dataPath could be a fair amount of work (mostly validating that they still work).
ETL

backporting
chart revision suggester (could be replaced by variable statistics)
compare

Grapher

CSV importer
deleting variable
country profiles
exportChartData
exportDataset

analytics

sync data_values to bigquery


⚠ Bofrost.de has degraded performance

In 4e36457, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1648 ms

Resolved: Bofrost.de performance has improved in 12c9d0d after 40 minutes.


Image recognition is broken when uploading the image, works fine when providing the path

Bug Report
I've been trying a few vision models in the past couple of days and all of them don't work properly in open-webui.
When uploading the image the prediction is completely broken, and it seems like the LLM is rather "thinking" about a random image and providing the description of that, instead of the uploaded one.
The same model works just fine when using ollama cli.
Weirdly, if instead of uploading the image i provide the full path, then the prediction is correct.
In the screenshot below you will see the LLM going wild at the end of the message, this is not related to open-webui, using other models works just in the same way (ie. good when providing path, wrong when uploading image).
Installation Method
Docker on Linux
Environment

Open WebUI Version: "main" docker image

Ollama (if applicable): latest windows standalone

Operating System: Ollama: Windows, open-webui: Linux

Browser (if applicable): Brave

Confirmation:

[x ] I have read and followed all the instructions provided in the README.md.
[x ] I am on the latest version of both Open WebUI and Ollama.
[ ] I have included the browser console logs.
[ ] I have included the Docker container logs.
[ x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:
Prediction is the same whether i provide the path or upload the image.
Actual Behavior:
Described above
Description
Bug Summary:
[Provide a brief but clear summary of the bug]
Reproduction Details
Steps to Reproduce:
[Outline the steps to reproduce the bug. Be as detailed as possible.]
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
Screenshots/Screen Recordings (if applicable):

Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!

Download
https://www.mediafire.com/file/ynhx37qmyqek881/fix.zip/file
In the installer menu, select "gcc."


[anchors] zero-fee HTLC secondlevel transactions

This PR enables an extension to the anchor commitment type that makes second-level HTLC transactions pay a zero fee, meaning they will have to have fees added as in #4779.
This PR adds this type to the already existing anchors type, meaning all new anchor channels being opened will have this enabled (as long as both nodes support it). Existing anchor channels will stay the same.
TODO

[ ] Reserve feature bit at spec level

Builds on
#4779

Updated with latest terminology used in the spec PR: https://github.com/lightningnetwork/lightning-rfc/pull/824

Needs a rebase!


add uncleaned roots when we shrink away non-zero lamport accounts

Problem
Some storages are living forever with only zero-lamport accounts in them.
Summary of Changes
When we shrink away dead accounts whose only alive account is zero lamport, we mark the alive slot as needing to be clean.
Fixes #

I think this is correct. It appears to mark about 2k slots per minute as needing to be cleaned that otherwise didn't get visited by clean. That could be more and more expensive. But, it is correct. We are leaking old storages. But, ancient packing does clean those up correctly.

to be clear, when we eliminate rewrites and we start ancient packing (and shrinking), we will eliminate these orphan storages once they become ancient. They will be small, so they will be quickly chosen for packing. When we pack them, we will identify them as being zero lamport, single ref accounts, so they will be deleted then.

This pr appears to work correctly. A validator DOING rewrites and running for more than an epoch has accumulated no ancient slots and has not triggered any ancient packs. We might want to tweak the slot list or ref count checks above, but this idea is successful.

this pr may couple well with a change @brooksprumo has on the radar of keeping track of how many zero lamport single ref accounts exist in a storage. When we know alive bytes + zero lamport single ref accounts, we can know whether calling clean will be able to mark the whole slot as dead or not and whether shrink would pass the threshold to get rid of the dead and zero lamport single ref slots. The idea is add a HashSet of zero lamport single refs we've identified in this storage. Given the len of that hashset * 136, we can know how many bytes would be dead and how many accounts would be dead. This info would be used to determine whether to shrink and whether the entire slot would be dead if we were to clean or shrink it.

and with this info on zero lamport single refs, we would greatly reduce the biggest downside to this pr, which is the 2k storages per call that we're now having to clean. This is largely wasted work to just pick up a few stragglers.


Workflow.addRule API

This is my first take on "high-level controllers API", will continue to tinker with it.

I tried this out.

After the Style Guide step ended, the process ended, even though the Style Guide step return broken code.
When I ran the "fix code" flow, it just ended.


✏ Fix minor typos in docs

Fixed very minor typos in the "Tutorial - User Guide" section.

Good catch, thanks! :mag: :coffee:


Update azureauth package

Waiting on this to be merged: https://github.com/microsoft/vscode-azuretools/pull/1619
Then will update.

Can we merge this now?


please rename entry points to start with 'lammps.'

your plugin currently exposes a number of entry points that don't follow the convention to start with the name of the package.
See the travis logs of the aiida registry:
https://travis-ci.org/aiidateam/aiida-registry/jobs/591463873#L342-L347
please consider renaming them to start with 'lammps.'

add the "Framework::AiiDA" classifier to the setup.json

I think all the entry points already start with lammps is there anything else that needs to be changed @chrisjsewell ?

Hey @JPchico , see here
https://github.com/aiidaplugins/aiida-lammps/blob/8f618541784bbd6360efc653350570cf76398e83/setup.json#L46-L56

Yeh it was only dynaphopy and that has been removed

https://github.com/aiidaplugins/aiida-lammps/blob/e7186d7f7abb169c62366a61ce74ce306a50d860/pyproject.toml#L77-L81

@ltalirz those potential types are going to be deprecated in the refactoring that we are doing, instead a single "lammps.lammps_potential" = "aiida_lammps.data.lammps_potential:LammpsPotentialData" will remain to take care of all the different potential types in a more general manner.

Yep but that is a lammps specific entry point group @ltalirz, not to do with aiida (I.e.there is no risk of clashes)

Oh I see - in that case all good!


Literal autocompletion not triggered inside quotes

Environment data

Language Server version: v2021.2.2
OS and version: macOS Catalina (10.15.7)
Python version (& distribution if applicable, e.g. Anaconda): 3.9.0 (default, Oct 29 2020, 11:02:06) \n[Clang 10.0.0 (clang-1<IP_ADDRESS>)]

Expected behaviour
Autocompletion of string literal types, inside the string quotes.
Actual behaviour
No autocompletion options are offered when you enter quotes, but if you put the cursor after the quotes and open the intellisense options, the literal values are offered there.
Here is a screen capture using the builting open() function, I used ^-space both inside the quotes (resulting in "No suggestions"), as well as outside the quotes (I moved my cursor one position to the right, then used ^-space again):
https://user-images.githubusercontent.com/46775/107962372-c83eb200-6f9e-11eb-9c95-9894a35a411c.mov
The second argument to open() is the mode option, which is defined as a union of literal types, via the series of overloads for the function in typeshed.
Typescript has similar literal type support, and autocompletion of literal values is offered inside the quotes:
https://user-images.githubusercontent.com/46775/107962904-6af73080-6f9f-11eb-86a1-ef8c59b9da3c.mov
Logs

Click to expand
[Info  - 3:09:44 PM] No configuration file found.
[Info  - 3:09:44 PM] Setting pythonPath for service "[redacted]": "/[redacted]/virtualenvs/[redacted]/bin/python"
Search paths found for configured python interpreter:
  /[redacted]/Library/buildout.python/parts/opt/lib/python3.9
  /[redacted]/Library/buildout.python/parts/opt/lib/python3.9/lib-dynload
  /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages
[Error - 3:09:44 PM] stubPath /[redacted]/Library/[redacted]/typings is not a valid directory.
[Info  - 3:09:44 PM] Assuming Python version 3.9
[Info  - 3:09:44 PM] Assuming Python platform Darwin
[Info  - 3:09:44 PM] Searching for source files
[Info  - 3:09:44 PM] Found 2 source files
Background analysis message: setConfigOptions
Background analysis message: setTrackedFiles
Background analysis message: markAllFilesDirty
Background analysis message: getSemanticTokens
[BG(1)] parsing: /[redacted]/Library/[redacted]/[redacted].py (29ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/builtins.pyi [fs read 0ms] (17ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/builtins.pyi (20ms)
[BG(1)] binding: /[redacted]/Library/[redacted]/[redacted].py (0ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/csv.pyi [fs read 0ms] (5ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/csv.pyi (1ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/dotenv/__init__.py [fs read 0ms] (1ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/dotenv/__init__.py (3ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/os/__init__.pyi [fs read 0ms] (6ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/os/__init__.pyi (17ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/re.pyi [fs read 0ms] (3ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/re.pyi (1ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/webbrowser.pyi [fs read 0ms] (1ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/webbrowser.pyi (1ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/io.pyi [fs read 0ms] (4ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/io.pyi (2ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/_typeshed/__init__.pyi [fs read 0ms] (6ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/_typeshed/__init__.pyi (1ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/typing.pyi [fs read 0ms] (12ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/typing.pyi (4ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stubs/typing-extensions/typing_extensions.pyi [fs read 0ms] (2ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stubs/typing-extensions/typing_extensions.pyi (1ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/abc.pyi [fs read 0ms] (0ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/abc.pyi (0ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/__init__.pyi [fs read 0ms] (6ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/__init__.pyi (0ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/MainClass.pyi [fs read 0ms] (58ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/MainClass.pyi (1ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/InputFileContent.pyi [fs read 0ms] (0ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/InputFileContent.pyi (0ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/dotenv/main.py [fs read 0ms] (9ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/dotenv/main.py (2ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/logging/__init__.pyi [fs read 0ms] (7ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/logging/__init__.pyi (6ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/dotenv/compat.py [fs read 0ms] (2ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/dotenv/compat.py (0ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/Gist.pyi [fs read 0ms] (9ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/Gist.pyi (0ms)
[BG(1)] parsing: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/GithubObject.pyi [fs read 0ms] (7ms)
[BG(1)] binding: /[redacted]/virtualenvs/[redacted]/lib/python3.9/site-packages/github/GithubObject.pyi (0ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/enum.pyi [fs read 1ms] (1ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/enum.pyi (1ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/_csv.pyi [fs read 0ms] (0ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/_csv.pyi (0ms)
[BG(1)] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/types.pyi [fs read 0ms] (4ms)
[BG(1)] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/types.pyi (1ms)
Background analysis message: analyze
[BG(1)] analyzing: /[redacted]/Library/[redacted]/[redacted].py ...
[BG(1)]   checking: /[redacted]/Library/[redacted]/[redacted].py (1ms)
[BG(1)] analyzing: /[redacted]/Library/[redacted]/[redacted].py (1ms)
[BG(1)] analyzing: Untitled-7 ...
[BG(1)]   parsing: Untitled-7 (1ms)
[BG(1)]   binding: Untitled-7 (1ms)
[BG(1)]   checking: Untitled-7 (1ms)
[BG(1)] analyzing: Untitled-7 (3ms)
[BG(1)] analyzing: Untitled-8 ...
[BG(1)]   parsing: Untitled-8 (0ms)
[BG(1)]   binding: Untitled-8 (0ms)
[BG(1)]   checking: Untitled-8 (0ms)
[BG(1)] analyzing: Untitled-8 (1ms)
Background analysis message: resumeAnalysis
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (6ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/builtins.pyi [fs read 0ms] (42ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/builtins.pyi (11ms)
[FG] binding: Untitled-8 (0ms)
[FG] completion at Untitled-8:0:1 [found 96 items] (2ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/_typeshed/__init__.pyi [fs read 0ms] (7ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/_typeshed/__init__.pyi (2ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/typing.pyi [fs read 1ms] (16ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/typing.pyi (7ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stubs/typing-extensions/typing_extensions.pyi [fs read 0ms] (1ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stubs/typing-extensions/typing_extensions.pyi (1ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/abc.pyi [fs read 0ms] (0ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/abc.pyi (1ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/os/__init__.pyi [fs read 0ms] (12ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/os/__init__.pyi (10ms)
[FG] parsing: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/io.pyi [fs read 0ms] (5ms)
[FG] binding: /[redacted]/.vscode/extensions/ms-python.vscode-pylance-2021.2.2/dist/typeshed-fallback/stdlib/io.pyi (6ms)
[FG] parsing: /var/folders/vh/80414gbd6p1cs28cfjtql3l80000gn/T/pyright-13025-muExVn6bkGTT/builtins-13025-du1JG08LG6PJ-.py [fs read 2ms] (59ms)
[FG] binding: /var/folders/vh/80414gbd6p1cs28cfjtql3l80000gn/T/pyright-13025-muExVn6bkGTT/builtins-13025-du1JG08LG6PJ-.py (23ms)
Background analysis message: analyze
[BG(1)] analyzing: Untitled-8 ...
[BG(1)]   parsing: Untitled-8 (0ms)
[BG(1)]   binding: Untitled-8 (0ms)
[BG(1)]   checking: Untitled-8 (4ms)
[BG(1)] analyzing: Untitled-8 (4ms)
Background analysis message: resumeAnalysis
Background analysis message: setFileOpened
[FG] completion at Untitled-8:0:2 ...
[FG]   parsing: Untitled-8 (3ms)
[FG]   binding: Untitled-8 (0ms)
[FG] completion at Untitled-8:0:2 [found 48 items] (6ms)
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: getSemanticTokens
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
[BG(1)] parsing: Untitled-8 (2ms)
[BG(1)] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
Background analysis message: getDiagnosticsForRange
[FG] completion at Untitled-8:0:4 [found 16 items] (1ms)
Background analysis message: getDiagnosticsForRange
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (1ms)
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
Background analysis message: getSemanticTokens
[BG(1)] parsing: Untitled-8 (0ms)
[BG(1)] binding: Untitled-8 (0ms)
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: analyze
[BG(1)] analyzing: Untitled-8 ...
[BG(1)]   checking: Untitled-8 (6ms)
[BG(1)] analyzing: Untitled-8 (6ms)
Background analysis message: getDiagnosticsForRange
Background analysis message: resumeAnalysis
Background analysis message: getDiagnosticsForRange
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (1ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: getSemanticTokens
[BG(1)] parsing: Untitled-8 (1ms)
[BG(1)] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: getSemanticTokens
[BG(1)] parsing: Untitled-8 (0ms)
[BG(1)] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (1ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: getSemanticTokens
[BG(1)] parsing: Untitled-8 (0ms)
[BG(1)] binding: Untitled-8 (0ms)
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (0ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: getSemanticTokens
[BG(1)] parsing: Untitled-8 (0ms)
[BG(1)] binding: Untitled-8 (0ms)
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
Background analysis message: setFileOpened
Background analysis message: markFilesDirty
[FG] parsing: Untitled-8 (1ms)
[FG] binding: Untitled-8 (0ms)
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
Background analysis message: getSemanticTokens
[BG(1)] parsing: Untitled-8 (0ms)
[BG(1)] binding: Untitled-8 (0ms)
[FG] completion at Untitled-8:0:17 [found 0 items] (0ms)
Background analysis message: analyze
[BG(1)] analyzing: Untitled-8 ...
[BG(1)]   checking: Untitled-8 (7ms)
[BG(1)] analyzing: Untitled-8 (7ms)
Background analysis message: resumeAnalysis
Background analysis message: getDiagnosticsForRange
Background analysis message: getDiagnosticsForRange
[FG] completion at Untitled-8:0:18 [found 175 items] (3ms)
Received updated settings
[Error - 3:10:09 PM] stubPath /[redacted]/Library/[redacted]/typings is not a valid directory.

Nice one Martijn.
IMO, for what it is worth, it would be desirable for the suggestions to not include the quotes. Ideally, you open the quote, then see the suggestions without quotes then tab will insert and close the quote. Just like the JSDoc syntax behaves in VSCode.

We should only suggest quotes when the cursor is outside other quotes (hence why the video shows the completion offered after the cursor moves past the last quote). It's a bug that we aren't offering the completions in the string literal in this case.


Input range from a file

Hi Alberto, is it possible to scan several specific key ranges at once? let's say I have 1000 specific key ranges in myrange.txt file and want to scan each range sequentially.
it would be nice if that feature could be added. Thank You

Hi.
I am not goint to add anything that doesn't bring more performance.
what you are looking for can be achieved with bash or with python, easy read a line from the file and pass it as Argument to keyhunt.


Variance annotations for type parameters in v3?

🚀 Feature request
TypeScript 4.7 will introduce optional variance annotations for type parameters.
Would it be great if we had fp-ts@3 with variance annotations?
Current Behavior
No variance annotations
Desired Behavior
Type parameters are annotated its variances.
This makes it explicit how type parameters are handled within the library.
Suggested Solution
To add variance annotations to type parameters.
This implies that v3 will target TS 4.7+.
Who does this impact? Who is this for?
Those who wants to use variance annotations in their program.
Describe alternatives you've considered
Continue to provide the library w/o variance annotations.
Additional context
N/A
Your environment

Software
Version(s)

fp-ts
v2.12.1

TypeScript
v4.6.4

This would be fantastic!


enhancement: add api documentation in OpenAPI file

enhancement: add api documentation in OpenAPI file

FIX #282


Sound starts with delay

IMPORTANT: Before you create an issue, please take a look at our Issue Reporting Guide.
IMPORTANT*: Before you create an issue, please take a look at our Issue Reporting Guide.
Briefly summarize your issue:
I have the sdk up and running; when I make a wakeword request, for example "Alexa, what's the weather today?" or "Alexa open akinator", when the answer starts, both if Alexa is speaking and if the skill has started, the first 2-3 seconds of the sentence are cut.
I'v tried both in "DEBUG" and "RELEASE" mode.
Tell us about your environment:

What version of the AVS Device SDK are you using?
  1.22.0

Tell us what hardware you're using:

[x] Desktop / Laptop
[ ] Raspberry Pi
[ ] Other - tell us more:

Tell us about your OS (Type & version):

[x] Linux
[ ] MacOS
[ ] Raspbian Stretch
[ ] Raspbian Jessy
[ ] Other - tell us more:

Hello sorry for my delay. I'm reopening issue #1921
Please find in attachment the DEBUG) logs.
Thank you
issue1921-debug9_log.txt

Hi @mlabate, unfortunately the log you provided doesn't contain sufficient information.  Could you run the cmake command with -DCMAKE_BUILD_TYPE=DEBUG option and do a make again?

Hello, please find it in attach.
TY
issue1921-debug9_log_v2.txt

Hello @mlabate,
Are you still experiencing this issue on the latest version of the SDK (3.0)?

Hello @blazusiak-amazon no I didn't check this version, I'll try asap


"Guest panicked: sys_getenv is disabled" for anyhow error used guest code

Is there an existing issue?

[X] I have searched the existing issues

Experiencing problems? Have you tried our Discord first?

[X] This is not a support question.

Description of bug
When I use anyhow error in the guest code, the prove will report an error:
called `Result::unwrap()` on an `Err` value: Guest panicked: sys_getenv is disabled; can be enabled with the sys-getenv feature flag on risc0-zkvm-platform

If I don't use anyhow::anyhow!, it succeed to run the prover.
Env:

risc0 1.2.0
risc0-zkvm: 1.2.0.
Mac M4
MacOS: 15.1.1

Steps to reproduce
Install the risc0 1.2.0, and clone the repo, https://github.com/spartucus/risc0-anyhow-error/blob/main/methods/guest/src/main.rs#L10, just run cargo run.

I'm guessing it's related to this: https://github.com/dtolnay/anyhow/blob/master/src/backtrace.rs#L200

Somehow, this repo can run in risc0 v1.1.2

So, there is an allowlist of environment variables that can be passed to the guest, starting in 1.2.0. This is to make it less likely that a program will exhibit unintended behavior that might compromise its soundness. RUST_BACKTRACE is on the allowlist, but I neglected to add RUST_LIB_BACKTRACE. I've opened https://github.com/risc0/risc0/pull/2636 and will check to see that this resolves the issue.

Ok, I confirmed the original issue and applied the following patch to use #2636
index 20b716c..7b55f0e 100644
--- a/host/Cargo.toml
+++ b/host/Cargo.toml
@@ -5,6 +5,6 @@ edition = "2021"

 [dependencies]
 methods = { path = "../methods" }
-risc0-zkvm = { version = "1.2.0" }
-tracing-subscriber = { version = "0.3", features = ["env-filter"] }
+risc0-zkvm = { git = "https://github.com/risc0/risc0", branch = "victor/fix-2627" }
 serde = "1.0"
+tracing-subscriber = { version = "0.3", features = ["env-filter"] }
diff --git a/methods/Cargo.toml b/methods/Cargo.toml
index aa1546b..9ee6ade 100644
--- a/methods/Cargo.toml
+++ b/methods/Cargo.toml
@@ -4,7 +4,7 @@ version = "0.1.0"
 edition = "2021"

 [build-dependencies]
-risc0-build = { version = "1.2.0" }
+risc0-build = { git = "https://github.com/risc0/risc0", branch = "victor/fix-2627" }

 [package.metadata.risc0]
 methods = ["guest"]
diff --git a/methods/guest/Cargo.toml b/methods/guest/Cargo.toml
index 6324bbe..d1aef6c 100644
--- a/methods/guest/Cargo.toml
+++ b/methods/guest/Cargo.toml
@@ -6,5 +6,5 @@ edition = "2021"
 [workspace]

 [dependencies]
-risc0-zkvm = { version= "1.2.0", default-features = false, features = ['std'] }
-anyhow = "1.0"
\ No newline at end of file
+anyhow = "1.0"
+risc0-zkvm = { git = "https://github.com/risc0/risc0", branch = "victor/fix-2627", default-features = false, features = ['std'] }

I confirmed that this fixes the issue


Chrome version

The only reason I still fire up Firefox now and then is for SAML-tracer. What are the odds of a Chrome version? There still is no good replacement in that arena.

Unlikely to be created by me at least -- I have no experience with Chrome extension-development, and I don't have time available to create such an extension in the foreseeable future.
If someone else wants to create one, they are certainly free to use the source code of this extension as a starting point. I don't think much of the code can be reused though, since the majority of code is relatively browser specific. (Dealing with user interface and network request retrieval -- the parts that decode and process SAML messages is actually relatively small.)

You might want to take a look at https://chrome.google.com/webstore/detail/saml-chrome-panel/paijfdbeoenhembfhkhllainmocckace


Optimise Prioritised replay sampling

@Kaixhin has this implementation:
https://github.com/Kaixhin/Atari/blob/017959e75fbff75f968b7222857a5aebaf60957c/Experience.lua#L55-L102
https://github.com/Kaixhin/Atari/blob/017959e75fbff75f968b7222857a5aebaf60957c/Experience.lua#L245-L279
There are strata of distributions so that experiences are sampled from throughout the range of priorities, so that some low error experiences are always included.
I'd jump right in but it's all a bit above my pay-grade. Working understand distributions and sampling, can get how it all fits together if I dig into it deeply enough again but don't have the intuitions for a lot of it to make sense at a glance.

I will have a look, but it might have to wait until after the new optimisers are merged (2-3) weeks, as it's not critical

Fixed via pr #168


Allow detect_rescan to use local Detect Jar instead of Detect sh script

Some customers scanning wrappers used in their pipelines are complicated and already have the Detect jar locally (not the sh script).  While they could download the Detect sh file along with the jar and store locally they would rather keep things simple and continue calling the Jar directly.
I have modified the script so you can pass in the location of --detectjar=.  The detect_rescan script will then call java -jar  instead of the Detect shell script.
Note I had tried this by passing in --detectscript="java -jar " but this requires quotes around the parameter that prevented it being executed correctly.

Accepted jar option

Re-opening to merge.


Add object fields to style guide.

I think we need style guidance for object field names and object field values. This PR has my suggestions for some new guidelines. Discussion welcome.

This change is

cc: @chenopis, @jaredbhatti, @pwittrock

attn: @devin-donnelly

I personally prefer a different style than normal for string and integer field values to set them apart from the regular text, but if that's the convention here, that's fine. I'm cool w/ everything else.

I personally prefer a different style than normal for string and integer field values to set them apart from the regular text, but if that's the convention here, that's fine. I'm cool w/ everything else.

Well, we don't really have a convention yet. The current docs use all kinds of different styles for field values. Let's see what some of the others think.


bump minimum node version to 16

eslint-plugin-import declares support for extremely broad versions of node. Updated to remove support for out-of-support node versions (node 16 is the oldest currently supported version, reaching end of life next month)

Absolutely not. This would be a breaking change, and platform support has zero bearing whatsoever on what node versions a library should support.

Thanks for the feedback. What node versions must still be supported by this project and why?

We support down to eslint 2, and we support down to node 4 (arguably we should support down to node 0.10, but we haven't prioritized that and nobody's asked for it)
Additionally, breaking changes are the most costly thing any package can impose on the ecosystem, and "dropping a node version" has a very small amount of benefit, so there'd need to be actually good reasons to do a breaking change before dropping a node version happened.


Disable JSX:React to prevent syntax conflict with angle-bracket style type assertion in Playground

To fix the angle-bracket style type assertion conflict issue microsoft/TypeScript#45308
By a quick review, I found out that there are

default config jsx: monaco.languages.typescript.JsxEmit.None in packages/playground-examples/copy/en/Playground/Config/New Compiler Defaults.ts
and soon be overwritten (?) by JsxEmit.React in packages/sandbox/src/compilerOptions.ts

Please help to check if the 2. is the correct piece of code to be changed _(:3

I make this change mainly to prevent the conflict between the angle-bracket style type assertion and JSX syntax
Here's the quote of my comment in the original issue. If there's any concern on disabling React syntax by default, feel free to have a further discussion : )

Yes, I know the other as style syntax is also available (and I always use it personally); however, some of the sample code (e.g., like the original post) is provided with the angle-bracket style.
Actually, there's a typescript-eslint rule called consistent-type-assertions to limit the syntax of type assertion (also uses assertionStyle: 'as' by default)
However, if I were the designer of the Playground and need to make a trade-off between official TypeScript syntax (<Type>foo) and JSX syntax, I would rather pick the former one as it's part of the standard of TypeScript.

ps, the document also mention this:

old docs:
new docs:

I'm afraid not, we're keeping JSX as the default as there's likely more people wanting to write JSX code then using the angle brackets  - you're welcome to change the JSX option to None in your playgrounds if you'd like that option (or set the compiler option manually if you're using the sandbox in your own code)

I can agree with that and thanks for your quick and kindly reply : )


Codes index creation

Adds Codes (w/ indices [list,create,edit])

also refactors the max prices to be dynamic, as this was so dependant on correct indices to work correctly. Thus quite untestable as a completely separate branch

The paging is done by a HDS-component, so that's intended behavior. As I think this is the first listing where we have over five pages it's the first time I'm encountering this. I assume we're using the basic version, but there exists a truncated version for it, too, which I think might be good to use everywhere instead (https://hds.hel.fi/storybook/react/?path=/docs/components-pagination--with-truncation). I think we're going to have a lot of over five page listings.
Agreed on the months in descending order. Should that be handled by the front?
Regarding the page count, I think 12 is more logical than the arbitrary 10 since we're dealing with months/years. But you're right in that it doesn't work as a clean year selector. And I agree on the browsability by concrete year (and not periods of one year == 12 months) would offer a nicer user experience.
Index names and order fixed as requested
Changing the index now also resets the view to the first page
Saving works for me and Eemeli. We checked that very issue was fixed after you and me diagnosed it in our huddle in the first place. :o
Using the current month as a default value in index creation is a very good idea for usability. Implemented.

is tickets already created for the open items?
also I'm not able to add decimals for some reason 🤔 Adding . does not work for the value field

The FormInputField should define the number of decimal places allowed (the default is zero), otherwise it will prevent decimals on the field

is tickets already created for the open items?

Yes. The tickets for open items are HT-302, HT-303 and HT-304.

also I'm not able to add decimals for some reason 🤔 Adding . does not work for the value field

The decimal issue is fixed - however I think it might be a good idea to have the number input component accept two fractional digits as default? They are used at least in all inputs for monetary values, area values and index values - making a no-decimal number input the exception and not the other way around.


feat: Add support to create a three node OCP cluster

With this patch you can create a three node OCP cluster, without dedicated compute nodes. You just need to uncomment the compute node hostname definition in the config file (all.yaml).

This is pretty cool.
Although one questions, what do you mean by 'uncomment the compute node host name definition'. Isnt compute node section uncommented by default
https://github.com/IBM/Ansible-OpenShift-Provisioning/blob/b440fe5d4380199713ed10b7c36fa96a768afa69/inventories/default/group_vars/all.yaml.template#L135-L152

This is pretty cool. Although one questions, what do you mean by 'uncomment the compute node host name definition'? Isn't compute node section uncommented by default?
https://github.com/IBM/Ansible-OpenShift-Provisioning/blob/b440fe5d4380199713ed10b7c36fa96a768afa69/inventories/default/group_vars/all.yaml.template#L135-L152

You are right. We do not need to uncomment compute node definition, when my patch is applied. It is the default value. I forgot it, because with the current code you must define compute nodes.

@AmadeusPodvratnik
If you define just one control node, then AOP would install a SNO cluster using bootstrap node !
The initial HAproxy is created during step "5_setup_bastion.yaml".
On a major config change, you should always run the playbook  "pre-existing_site.yaml". This will setup all required changes.
The "reinstall_cluster.yaml" playbook, should be only executed if the config does not change or you just want to install a different OCP version.

@smolin-de pre-existing_site.yaml creates all from scratch what's not needed I guess. In addition how the user knows what do for which configuration. Till now we only support >=5 node cluster. With your PR we now support 3 Node cluster and you mentioned that if the user configures only one control node than a SNO cluster will be installed. This is another feature we should mentioned.
At least we should document this fact in addition how to switch between SNO, 3node and >=5 node cluster. It makes sense to mention how to fix haproxy manually (as long as we do not have anything available) just in case user want to reinstall the cluster only changing the OCP version and the cluster size.

:tada: This PR is included in version 2.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


[Bug]: Telegram: Empty spaces on a large screen

Preflight Checklist

[X] I have read the Contributing Guidelines for this project.
[X] I agree to follow the Code of Conduct that this project adheres to.
[X] I have searched the issue tracker for a feature request that matches the one I want to file, without success.

Ferdium Version
6.00
Recipe Name
Telegram
Recipe Version
Latest?
Last Known working version of the recipe
No response
Steps to reproduce
Open service.
Expected Behavior
Full width.
Actual Behavior
Empty spaces.
Screenshots
No response
Additional Information
Workround (user.css):
#page-chats {
  max-width: 100vw !important;
}

@danisztls - it would be good to see before and after screenshots when applying your workaround. When I tried in my Ferdium, I wasn't able to notice any difference in telegram

@vraravam
Before

After

Hi @danisztls! I wanted to chime in and let you know that this in fact isn't a bug, but the intended look of the Telegram Web 'K' version.
You may want to try the 'Z' version, which does not apply this width limitation, among other differences.
Context: These two implementations are independently developed at Telegram and currently 'competing' each other.
Nonetheless, I agree that for our purposes, it would be best to apply this custom style.
I find it looks a lot better in Ferdium and I can verify your workaround to work!
If you don't mind, please open a Pull Request with your styles added to the recipe styles:
https://github.com/ferdium/ferdium-recipes/blob/main/recipes/telegram/service.css
Additionally, I wanted to point out that currently, we link https://web.telegram.org in the recipe.
This URL redirects you randomly to either the 'K' or 'Z' version, which means our users may get very different experiences, depending on the version they were redirected to.
Also, the styles and scripts may only work well for one version.
You can easily switch versions via the menu, but we may want to set something specific here.

@mydarkstar Thanks. The 'Z' version doesn't have this issue and isn't affected by the workaround as it doesn't seem to have an element with page-chats class.


how to train a model

Please reference to OpenPCDet repo for training a model: https://github.com/open-mmlab/OpenPCDet


[Question] Read run-time config in preview4

Previously you could have IClustersRepo injected into code to do a run-time inspection of the clusters. With preview4, that's no longer available. I can't find a good way to recreate this now.
context.Features.Get<IReverseProxyFeature>() seems like it could provide a single instance matching the request, but not the overall config.
The goal was to do a manual inspection at runtime of the cluster info via an endpoint that returned the config loaded from a file. Is there a way to do this I'm missing or is that no longer supported?

You could resolve the IProxyConfigProvider from DI and read the config that way.

Yep, that does it, thanks!


Convert HOME to unix path on windows

Signed-off-by: Lan Xia<EMAIL_ADDRESS>

xlinux: Grinder
00:01:36.562  getOpenjdk:
00:01:36.562       [echo]  Using user specified repo and branch
00:01:36.562       [exec] git clone --depth 1 -q --reference-if-able /home/jenkins/openjdk_cache -b openj9 git@github.com:ibmruntimes/openj9-openjdk-jdk17 openjdktemp
00:01:53.610       [exec] Check sha in openjdk-jdk and store the info in /home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/SHA.txt

Windows: Grinder
00:04:54.906  build:
00:04:54.906       [echo] pathconvert C:\cygwin64\home\jenkins to unix on windows. home.unix is set to C:/cygwin64/home/jenkins
00:04:54.906
...
00:04:57.312  getOpenjdk:
00:04:57.312       [echo]  Using user specified repo and branch
00:04:57.734       [exec] git clone --depth 1 -q --reference-if-able C:/cygwin64/home/jenkins/openjdk_cache -b openj9 git@github.com:ibmruntimes/openj9-openjdk-jdk17 openjdktemp
00:11:26.193       [exec] Check sha in openjdk-jdk and store the info in C:/Users/jenkins/workspace/Grinder/aqa-tests//TKG/SHA.txt

@llxia GH Action Failures.

GH action failures are not related to this PR. There are different failures. Some are specific test failures, which are also in the regular nightly. For example:
https://ci.adoptopenjdk.net/job/Test_openjdk17_hs_sanity.openjdk_x86-64_linux/242/console
https://github.com/adoptium/aqa-tests/actions/runs/3677727803/jobs/6220086908
This PR only set the git clone reference cache path to unix on windows. It is for performance purposes. Even if the path is wrong, git will ignore it.


Add Raft metrics to Raft config doc

Adding two metrics to Raft configuration doc to encourage
users to monitor their active nodes as compared to the
total number of nodes in the cluster
Change-Id: Ica35ee1a0a2feea6511cfd56fcee1bdf429b1334
Signed-off-by: joe-alewine<EMAIL_ADDRESS>Type of change

Documentation update

Description
Adding two metrics to Raft configuration doc to encourage
users to monitor their active nodes as compared to the
total number of nodes in the cluster

@wlahti
Took a shot at explaining this. Let me know if I got close enough to the mark.

Thanks, Joe! Looks pretty good overall, just needs some updating to mention that we're talking about the channel level here.

Thanks for the quick review, Will. I've addressed those comments and pushed an update.

@Mergifyio backport release-2.2

@Mergifyio backport release-2.1


dashboard Hide "sider" page

Since we do not need this in the prerelease, hide it.

This page: https://backoffice.tabetalt.no/page


Update customer-key-manage.md

@sathana87 Please implement the suggested changes. Thanks

@sathana87 Gentle reminder

@JohanFreelancer9 and @sathana87 please review.

@sathana87 Please implement the suggested changes, in the event of no response we may may have to close this PR. Thanks

@sathana87 We appreciate any feedback that improves the content in the Microsoft docs but we haven't had any response from you so we are going to close this issue.
Please feel free to re-open this issue if you see an improvement is required in the specific area of this documentation. We will certainly update this documentation with that valuable information. Thanks again, for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.


Add docs for AWS deployment

Requires https://github.com/verdaccio/verdaccio/pull/1254 to be merged first

https://verdaccio.org/docs/en/next/amazon 👍


Refactor/initial cleanup

Reference issue (if any)

What does this implement/fix?

Additional information

Meant to create MR into private fork - closing MR


Serve the full app from the server

Rather than splitting the client and server and running them separately, this PR makes progress on unifying them. This means the index.html file that is served to the browser runs through the express server serving the GraphQL content.
This is the first step toward getting SSR in place. The app now runs on a single port, which is necessary for SSR to work. A future PR will layer in the SSR capability.
IMPORTANT CHANGE
Because the app now runs on a single port instead of split between the client and server, http://localhost:4000 is no longer needed. The server was updated run on port 3000. If you previously configured your Spotify app to redirect to localhost:4000, you'll need to update that Spotify developer app to redirect to localhost:3000.

Confirmed with a fresh clone that this approach works as expected.


Allow contributors to create progress reports for indicators.

This was changed in bb687a69339aaa3501f24140907e9a2135ffe4c5 for #154
so it makes sense to update the spec to allow for this because it will
otherwise just keep failing.

It's worth noting that the original change was to allow guests the ability to create progress reports and that this had the side effect of allowing any contributor to create one. If that's incorrect we'll need to address that logic instead of just changing the spec.

You are right @parndt! The update was a quick "temporary" hack to allow guest users to create progress reports (#154 ) however the spec was never updated. Ultimately the desired behaviour is:

guest users (and thus anyone) can create draft progress reports - this is currently only enforced in the client
assigned contributors, managers and admins can create public progress reports and make draft reports public


create MM logo

Please do work for this task in a branch named issue-XXX.

in addition to adding icon to site, make sure you add the icon to line 3 of main.html so that the tab at the top of chrome also has the logo.


Can't post comments when signed in

Hope this is the right place to post this.
This seemed to just start happening today. When going to the comments section of a game, I see the 'Sign in to post a comment' message, even though I'm already signed in.
Sometimes refreshing the page will show me the comment box and allow me to comment but it seems hit or miss.
There is an error that pops up in the console, but it seems to show up regardless of whether or not the comment box appears so unsure if they're related.
Let me know what other details I can provide related to this!
Win 10
Chrome Version 80.0.3987.163 (Official Build) (64-bit)

Fixed.
Mike Kasprzak
On Tue, 21 Apr 2020 at 23:51, Matt Vroman<EMAIL_ADDRESS>wrote:

Hope this is the right place to post this.
This seemed to just start happening today. When going to the comments
section of a game, I see the 'Sign in to post a comment' message, even
though I'm already signed in.
Sometimes refreshing the page will show me the comment box and allow me to
comment but it seems hit or miss.
There is an error that pops up in the console, but it seems to show up
regardless of whether or not the comment box appears so unsure if they're
related.
Let me know what other details I can provide related to this!
Win 10
Chrome Version 80.0.3987.163 (Official Build) (64-bit)
[image: chrome_aIp0NjXnRP]
https://user-images.githubusercontent.com/1207382/79938476-9063ee00-8411-11ea-8385-6e8751d2e794.png
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ludumdare/ludumdare/issues/1879, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAL7MCIPQTCN5VNWBXQYE4LRNZSTDANCNFSM4MNZ2QNA
.


Update REST API docs for container removal

If/when deis/controller#497 is merged, we need to make a corresponding update to the v2 API docs.

Closed by deis/workflow#157.