parameterize max messages per ICA

Context
To optionally enable delegations to the whole validator set, this PR parameterizes the number of messages per ICA.
Brief Changelog

Added parameter MaxIcaMessagesPerTx
Replaced the hard coded "batch size" with the parameter
Sorted the unbonding messages by unbalance ratio (reversion of this commit). The sort was changed a few upgrades ago to ensure that the number of validators was under the limit, but that is no longer necessary
Added new parameter in upgrade handler

Assumptions made (please check me!)

~We can change the sort now that we're delegating to more than 32 validators (in fact, if we don't add it back in, we won't be able to unbond from the full set)~ EDIT: Leaving the sort as is in case we run into issues over 32 vals
ConsolidateUnbondingMessages should be left in place in case we want to set the parameter back to 32
There isn't anything we need to do for delegations since we can control it by adding/removing validators
Confirm all our parameters are currently set to the default on mainnet

https://docs.google.com/spreadsheets/d/1eMvlfZTLTt9_TElU2l5nhSv9LvKJdt4dtVEwZ2SSg5w/edit#gid=0

min across all chains is Evmos with 40M, not sure that's enough to support a tx that stakes/unstakes to 100 vals (on Celestia a tx with ~70-80 takes ~25M gas, but it's been a bit unpredictable so would be nice to leave a buffer)

I don't think this will work - some host zones have lower gas limits. I thought we were going to do this by host zone, not across them all

I thought you said to do it as a global param and we would control the list of validators for non-hub/osmo
@asalzmann

Vishal and I chatted

Main relevant deadline for delegating to more than 32 vals is when Celestia adds ICAs (so we can continue delegating to the whole set) - likely April
In theory, we could set the limit higher today (e.g. 100 vals) and keep track of how many validators we delegate to by host zone, but seems complex / like a lot of work
Adding this as a param vs. having it hard coded doesn't add much value

=> going to close this PR in favor of either setting this by host zone or adding a proper fix (unbundling the staking/unstaking tx so they can be spread across multiple txs) in a later upgrade


Add new Capabilities field containing environment capabilities.

Towards: https://github.com/giantswarm/giantswarm/issues/16806
To allow kubectl-gs to default availability zones we need to know what availability zones are available in each location.
This PR adds support for such field in athena
Checklist

[x] Update changelog in CHANGELOG.md.

Have you considered providing this information via the Management API? If we add services/information to athena, we are building up a second API users have to know and find documentation for. So in general we should have a good reason to use athena for this.
athena exists to help kubectl-gs to authenticate to installations. Once a client is authenticated, additional information can be fetched from the Management API.

Have you considered providing this information via the Management API? If we add services/information to athena, we are building up a second API users have to know and find documentation for. So in general we should have a good reason to use athena for this.
athena exists to help kubectl-gs to authenticate to installations. Once a client is authenticated, additional information can be fetched from the Management API.

:sadpanda: I just followed the approach we discussed here https://github.com/giantswarm/giantswarm/issues/16667

I'm sorry for that! I probably didn't understand enough back then. Also I had (probably after that) @teemow give me his clear opinion that we should use the Management API only if possible.

I'm sorry for that! I probably didn't understand enough back then. Also I had (probably after that) @teemow give me his clear opinion that we should use the Management API only if possible.

No worries, will think about using MAPI


ComputeSideEffects: fix a corner case with consuming indirect arguments in dead-end functions

Usually there must be a read from a consuming in-argument, because the function has to consume the argument. But in the special case if all control paths end up in an unreachable, the consuming read might have been dead-code eliminated. Therefore make sure to add the read-effect in any case. Otherwise it can result in memory lifetime failures at a call site.
fixes a memory lifetime failure
rdar://134881045

@swift-ci test


training dataset

After reading the readme file, it's still not clear to me what data set was used for training? I understand some filters are initialized from vgg16, then training is done on what dataset?
By "No Pascal VOC finetuning was applied to the weights.", I guess the training set is not Pascal VOC?
Thanks,

Vgg16 is trained on ImageNet. No further training was performed. The model is meant to be a good start to do FineTuning on your own data.

Great. Thanks for the reply. Would be good to see such information on readme file.

The Readme currently says:

No Pascal VOC finetuning was applied to the weights. The model is meant to be finetuned on your own data.

Isn't this a clear statement?


Enable kast tests

Fixes #4

One question. Why is the version bump the first commit?

I did a rebase.


Include "Kali Rolling" based on Debian Testing

The script throws an error when os_version is "kali-rolling".  The modifications allows to run the script against Kali Rolling. Ref.: https://www.kali.org/docs/policy/kali-linux-relationship-with-debian/

Sorry, I have no plans to support Kali.


Concurrent repair or one-by-one

Hi Dear Author, here is a question about the testing details in your ICLR'18 paper (Learning to Represent Programs with Graphs). On the example programs in your paper, the model can successfully predict variables in many slots (like the image below, which is a figure from your paper). I just wondering the way to predict all these slots in the test stage after training, is that:
(1) the model predicts variable in all slots at the same time
(2) or, the model predicts the slots one by one, each time you only remove the variable in one slot, and predict it; next time restore that last slot back and remove the variable in another slot, then predict it; ..., do this prediction in an iteration.
Which one is a correct understanding in your detailed realization? Or, both incorrect since there is another way to predict the contents in all these slots? Thanks!

Heya,
Indeed, for the results in the ICLR'18 paper, we used the approach that you describe in (2) (fill in one slot, conditional on correct content for all others). However, our related, earlier work, we discuss how to use iterative conditional modes to extend to the fill-all-slots-at-once setting (see https://arxiv.org/pdf/1705.07867v1.pdf, Sect. 3.1).
Marc


[Query Expressions] Formatting not works in VSCode Plugin

Description:
Code formatting not works for query expressions and streams in VSCode plugin.
Steps to reproduce:
Please checkout the Query and streams examples.

https://ballerina.io/swan-lake/learn/by-example/query-expression.html
https://ballerina.io/swan-lake/learn/by-example/query-expression-to-stream.html
https://ballerina.io/swan-lake/learn/by-example/query-expression-to-string.html
https://ballerina.io/swan-lake/learn/by-example/query-expression-to-table.html
https://ballerina.io/swan-lake/learn/by-example/query-expression-to-xml.html
https://ballerina.io/swan-lake/learn/by-example/query-action.html
https://ballerina.io/swan-lake/learn/by-example/query-join.html
https://ballerina.io/swan-lake/learn/by-example/streams.html

Fixed with PR: https://github.com/ballerina-platform/ballerina-lang/pull/26391


Define supported platforms

Re-reading through the issues I notice we often have issues with uncommon setups.
With the incoming premium extensions features, we can't afford to have broken setups like that pop up so often. We also need to clear these issues from the tracker instead of keeping them opened forever.
I suggest we define the following:

Server OS supported
Webserver supported
Database supported
Browsers supported to use the GUI

We don't need to block access to others, but we won't offer support.
In particular I'm thinking of officially dropping support for:

Windows/IIS. Unless we get a Windows developer onboard we just can't troubleshoot issues with that
MariaDB. There are so many weird things with Flarum and MariaDB right now
Mobile browsers, Unless we refactor the UI to be more responsive I don't think it makes sense to troubleshoot mobile issues. Also the premium checkout process is not optimized for mobile at all, and I don't think it would make any particular sense at this time

This would give us something like this:

Linux
Apache/Nginx
MySQL
Latest Firefox/Chrome

Browser support should probably be the same as whatever we define for flagrow.io dashboard.
What do you think @luceos ?

I agree, we need to clearly spec out the requirements.

Which versions of PHP are supported ?

The same ones Flarum does: php 5.6 (until beta 8), php 7.0 and 7.1. I think we'll hit PHP 7.2 with Flarum beta 8.


[Bug]: Different versions (0.4.x) database files cannot be migrated

What happened?
Full process:
step 1:
version 0.4.2 create collection and persistent on sqlite3
step 2:
version 0.4.2 query success: both collection.get and collection.query return records.
step 3:
update to 0.4.9 query success but collection.get is empty and collection.query return error records.
step 4:
rollback to 0.4.2 use function collection.get exception error: sqlite3.OperationalError: no such table: embedding_fulltext
Versions
step 1:
Chromadb 0.4.2, python 3.10, aarch64 Centos 7.9
step 2:
Query : Chromadb 0.4.2 python 3.10 MacOS Ventura 13.5.2
step 3:
Update: Chromadb 0.4.9 python 3.10 MacOS Ventura 13.5.2
step 4:
rollback: Chromadb 0.4.2 python 3.10 MacOS Ventura 13.5.2
Relevant log output
step 4: sqlite3.OperationalError: no such table: embedding_fulltext

Is there any response to this? I have been facing this issue for a couple of hours now

@tazarov can you take a look here?

hey @BrianMwas,
We do not support downgrading versions due to how metadata migrations work and the fact that reversing them is not easy or feasible. The sqlite3.OperationalError error is expected due to the downgrade you made.
The above aside I tried to reproduce your setup where:

run a 0.4.2 server
Add some data and query it it

Server logs look fine:

DB also looks fine:

Upgrade the server to 0.4.9
Add/Get/Query data

Upsert/Get/Qeury seem to be working fine:

Server logs look fine:

DB also seems fine:

Downgrade to 0.4.2 <-- This is where I started seeing the operational errors on new inserts, but get and query appears to be working just fine.

Server runs fine for Get and Query:

Adding data produces an error in the server:

As a result of the error, the embedding is inserted, but metadata is not (e.g. the document and any metadata attributes):

Conclusion
Upgrading from 0.4.2 to 0.4.9 appears to work as expected (at least on the same platform).
I have created a repo if you want to play around/reproduce with the above setup - https://github.com/amikos-tech/chromadb-version-debug
Get in touch on discord (taz) if you are stuck and can't continue with your upgrade.

@BrianMwas, did you solve your issue, or would you like to talk your challenge through?


MAS submission sandbox error - Contents/MacOS/MyApp

Im getting this error when i try to submit to MAS -
ERROR ITMS-90296: "App sandbox not enabled. The following executables must include the "com.apple.security.app-sandbox" entitlement with a Boolean value of true in the entitlements property list: [( "com.MyApp.pkg/Payload/MyApp.app/Contents/MacOS/MyApp" )]"
added that file to the script described here: http://electron.atom.io/docs/v0.35.0/tutorial/mac-app-store-submission-guide/ but get the error "Contents/MacOS/MyApp: bundle format unrecognized, invalid, or unsuitable", so that doesn't seem to do anything.
any ideas on how to sandbox Contents/MacOS/MyApp?

Could be either missing or wrong bundle identifiers.

The signing tool seems to behave differently on different versions of OS X, you can also try this script:
https://gist.github.com/jorangreef/27e708c67b7e6746a98a


Create a project template

After submitting the crate to crate.io create a template like cw-template to help developers starts creating smart contract that needs to use Desmos messages.

Template repository available at: https://github.com/desmos-labs/cw-template


Write up instructions on how to run the validation tool and create sample data

Add documentation on how to run the validation tool, and how the input is given (https://github.com/Azure/azure-rest-api-specs/issues/648)

#33


Updated with note about wi-fi deprecation

@alkohli @dansisson -

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

Note: I've made a change to the note that should be committed before sign off. thanks
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@Jak-MS
Just heard back from the SME.
I have what I need now.
Continuing content development.
Thank you.


add OS helper

adds more OS detections to Helper class
required for: https://github.com/fastlane/fastlane/pull/6871

@milch feedback addressed.

Thanks for your contribution! 🚀


Add the possibility to download an external resource in a subdir

This PR adds the possibility to load external resources in a subdirectory

LGTM

Maybe using os.path.exists is semantically better, but it's fine.

No, you need nothing to be able to create a directory. You can't create a directory if it's a file. Then you will not receive the error you expect. But it's a detail.


GeoPackage exports should be usable in QGIS

To reproduce

export something to GeoPackage, wait for it to finish and download the file(Mine is available on  http://<production domain>/downloads/484a0633-38ca-4f06-a1a3-621dc2903882/.)
unpack the Zip archive (2016-05-13-FrankfurtamMain-484a0633-38ca-4f06-a1a3-621dc2903882.gpkg.zip in my case)
drag & drop *.gpkg/data/*_gpkg.gpkg (2016-05-13-FrankfurtamMain-484a0633-38ca-4f06-a1a3-621dc2903882.gpkg/data/20160513-frankfurt-am-main_gpkg.gpkg in my case) into the QGIS layers panel (or open it with Layer > Add Layer > Add Vector Layer ... / Ctrl+Shift+v / the according button)

Expected
The list of usual layers of the OSMaxx output schema is displayed, with the appropriate respective geometry types.
Observed

The list of usual layers of the OSMaxx output schema is displayed, but with geometry type None for all of them
additional layers are displayed. The names look like it might be GeoPackage interna.

Maybe we should investigate updating our docker-gdal-with-FileGDB image first, before trying to solve anything else?

This seems to be a bug in the QGIS version, it works alright here.

On QGIS 2.14.2-Essen, analogous unexpected behavior can be observed for GeoPackage files that weren't produced by OSMaxx:

http://ngageoint.github.io/GeoPackage/examples/rivers.gpkg
http://www.geopackage.org/data/simple_sewer_features.gpkg
http://www.geopackage.org/data/gdal_sample.gpkg

So this is most probably a bug in QGIS.
Closing as invalid.


Introduce 'package' definition and validation

Introduces the 'package' definition and validation that #64 requires for its RPM resolution logic. This is introduced in a separate PR in order to reduce the complexity of #64.

@jdob as discussed here the encryption/decryption of the RegCode will happen in a different PR after #64.
Would it also be a good idea to handle the AddRepo enhancement described here in a different PR also after #64, so that we can have a working base on which we can build on top of?

@jdob as discussed here there will be an issue for the RegCode being included as plain text which will be handled by a different PR in the future.
Would it also be a good idea to handle the AddRepo enhancement described here in a different PR also after #64, so that we can have a working base on which we can build on top of?

Agreed, we can revisit the repo definition thing, no need to block this PR.

Agreed, we can revisit the repo definition thing, no need to block this PR.

Okay, I will directly open a PR with the repo definition logic once we review and merge #64


Example showing how to manually load SPIR-V shaders from disk

This PR adds one simple example demonstrating how to write structures that describe shader layout, normally generated automatically by VulkanoShader derive macro and then load the shader from external source (disk).
There are valid use cases when user wants to load shader files from external sources and this example aims to demonstrate how to do so.  It shows things normally done by VulkanoShader macro and explains why certain things are done.

Fixed, sorry for delay.

Thanks


zap parser: add title to dedupe fields

The current dedupe config for ZAP scans is "not unique enought":
ZAP Scan': ['cwe', 'endpoints', 'severity']
even our own zap sample contains multiple different findings with the same cwe + endpoints + severity, so we need to include either the name or pluginid or alert fields.
https://github.com/DefectDojo/django-DefectDojo/blob/dev/tests/zap_sample.xml
Only the name field is available in defect dojo and it is stored in the title field, so unfortunately we have to include the title field`

What do you think @ptrovatelli

OK what you're pointing out is problematic indeed. I guess we can use the title until we find something better;


SSL Certification hangs

I tried connecting to a local murmur server and to an online one. In both cases the connection hangs at  _ssl.AuthenticateAsClient(_hostname); in MumbleTCPConnection

What Unity version? Have you tried setting the API compatibility to 4? Does this happen in build and editor?

I 'm using 2018.2.3f1 and I 'm using Scripting Runtime Version .Net 4.x Equivalent and Api Compatibility.Net 4.x

I'm not really sure what the issue could be. Does it happen only for one server, or any public mumble server?

I tried both with public and private server. I 'm not sure why it happens, it works alright with .Net 3.5 but hangs with .Net 4 . I 've been reading issues from the forums like this one [https://forum.unity.com/threads/unitywebrequest-unable-to-complete-ssl-connection.566380/](unity Forums thread) and it seems to be a problem on Unity's side :/

@zakur0 Did you find the cause of this issue? If not, I'd rather leave this open


Potion KHR_materials_transmission render clash

TIL that our potion uses KHR_materials_transmission which seems to be doing a separate render pass to create its effect. I discovered this because it interferes with the minimap's rendering (changes the renderer state while it is rendering, like a mirror).
In addition to the fact that this might cut our performance in two, it is bugged. We'll need to either remove this extension, bugfix it, or coalesce it into a more structured pass that does not interfere with drones/mirrors/camera/diorama/portals/minimap, and similar places we do multiple render passes.

On further digging, this is probably caused by the transmission render step, transmissionRenderTarget.

Research:
https://threejs.org/examples/?q=trans#webgl_materials_physical_transmission
https://medium.com/geekculture/understanding-the-three-js-transmission-example-13e952a8ab55
https://github.com/mrdoob/three.js/blob/f9cd9cab03b7b64244e304900a3a2eeaa3a588ce/src/renderers/WebGLRenderer.js#L1196

Fixed with https://github.com/webaverse/totum/pull/67

Fixed in this branch with. https://github.com/webaverse/app/commit/84ba8af770d2e33cc9de03cc47d560c0500e9d08

Note that this should drastically improve performance for scenes that had the potion in them.


New version: ProximalOperators v0.10.2

Registering package: ProximalOperators
Repository: https://github.com/kul-forbes/ProximalOperators.jl
Created by: @lostella
Version: v0.10.2
Commit: 1d265e52858476fdace71a6def7c4613ccaf43af
Reviewed by: @lostella
Reference: https://github.com/kul-forbes/ProximalOperators.jl/commit/1d265e52858476fdace71a6def7c4613ccaf43af#commitcomment-34210086
Release notes:

Fixes for Julia 1.2

I'll actually change the [compat] section to allow for >= versions, please do not merge


Add FDP user documentation

https://github.com/NLeSC/ODEX-FAIRDataPoint/commit/2b780981f962594b4e4ea43c1d3388b6685843ab
https://github.com/NLeSC/ODEX-FAIRDataPoint/commit/337c0a1c0ed8e9f76fab7b5a095a8338ff7cb0cd


Feature/ibeacon scanner app

Transform library project into a generic ibeacon scanner app. The app reports all sighted ibeacons in the area.

Change scan filter to return all ibeacons.
Add recyclerview layout to display ibeacons.
Add error views (no bluetooth, no location, no permission, empty view).
Add signing config to publish to play store.

Wrongly created this cross repo pr :(.


Temporal update of the tree-crown data source

Summary

Update data source of the tree crown data which doesn't longer work with the intake fetcher plugin.
List of changes proposed in this PR (pull-request)

Change the source from https://github.com/shmh40/detectreeRGB-treecrown-scivision to https://github.com/acocac/detectreeRGB-treecrown-scivision

What should a reviewer concentrate their feedback on?

[ ] Everything looks ok?

Acknowledging contributors

[x] All contributors to this pull request are already named in the table of contributors in the README file.
[ ] The following people should be added to the table of contributors in the README file:

@acocac Is this ready to be merged?

I deleted the forked repository because the example was only for the demo at the Space Day so I suggest to close the PR.


Ripple effect FPS

To me it seems that ripple effect buttons have low framerate, so the circle expanding in them kinda 'lags'.

GIF is recorded at 60fps

I'm pretty sure that the animation speed is limited by qt and not chatterino itself so I'm gonna close this issue since this can not be fixed.


Customize Open recent command

Issue Type: Feature Request
Currently using Open recent command (Ctrl+R) I'm shown 100 recent folders first and then 100 recent files. I for one definitely don't need that many folders remembered, and would prefer files coming up first (and maybe increase their count to 150). Would be nice to have it customizable in settings.
VS Code version: Code 1.60.1 (83bd43bc519d15e50c4272c6cf5c1479df196a4d, 2021-09-10T17:07:10.714Z)
OS version: Windows_NT x64 10.0.19043
Restricted Mode: No

Slightly related, I just merged https://github.com/microsoft/vscode/pull/135741 that increases the limit to 500.


Statements & Truth Values

We need to begin this project by enabling the creation and persistence of statements, and by preserving their truth-values (this will be vital later when we start talking about the program recognizing the difference between a sound rule and a valid rule).
Method
If we can send the program values, we can start with very simple objects, like:
const statement: Statement = { text: 'A statement that you like.', truthValue: true }

To keep thing exceptionally simple. Preserving them as such, we can start to string them together.
Complications
The program will need to recognize the formal difference between a statement and another kind of sentence construction. This is where things get complicated. Take the following inputs as examples:

All dogs are liars.
Gerhardt von Habsberg died in 1923.
is not a whale
Who am I?
Tark tark aortum .
If all dogs are liars, then no dogs can be trusted.

Only the first two strings can be considered valid statements, or "facts" to be processed by the system. The other chunks are just that - chunks, questions, etc. Parsing the grammar on them to determine which are valid will be quite a challenge.
We can filter out some values quickly - say, a filter for ? or if, then statements is easy enough. Some of the others might require a degree of language recognition. But for an MVP it is possible that we can just document the module's usage well enough to tell users, "Do not submit non-statements, or your instance of the module will not work."

We're going to start by experimenting with the NPM compromise package.


App Crash when Cut  command (CTRL+X) if text selected

Sometime when you push  CTRL+X to cut if text selected will crash the app,
if not text selected will always say nothing to cut.

No. I use latest in F-Droid witch is V2023.1.1
I will manual download the mentioned one from githb and test it...

I test it
Now the behaviour has change

sometime it cut
most of time not (text remain in place)
Better, but probably there is also some error in other place in the code

It may be relatet to phisical keyboard... not soft one (I do not have time right now to test)

Okay, I need time to investigate this 🤔

I make some more test and here is what I found:

touch select text and cut with CTRL+x - it works all the time
keyboard select Shift + Right Arrow then CTRL+x  - it works all the time
keyboard select Shift + Left Arrow then CTRL+x  - it Does NOT work at all

Probably in the code is missing some behavior response or maybe a mispelling

Okay I think I found the issue, try this build -<PHONE_NUMBER>

super... issue solved
this bug can be closed

Thanks, I'll leave it open until these changes appear in the master branch

In latest version from F-Droid, I am getting crash on cut sometimes too.
Crash is reproducable, and seems to happen in these conditions:

Vertical overflow: there are more lines than can be shown in one screen.
Last line wraps at least twice.
A selection which, includes last line, is cut.

In screenshot below, the crash happens when cutting, but if I remove one linebreak or one a, then there's no crash when cutting last line.


Prevent checkout if you have "persist_to_workspace"

Orb version:
<EMAIL_ADDRESS>What happened:
When I try to persist the working environment persist_to_workspace and use it, to avoid the checkout step, I don't succeed.
# config.yml

...

jobs:
  # Checkout custom job to only clone the latest changes.
  custom-checkout:
    docker:
      - image: cimg/base:2023.02
    steps:
        ...
      - run:
          name: Clone bitbucket repository
          command: git clone --depth 5 "$CIRCLE_REPOSITORY_URL" --branch "$CIRCLE_BRANCH"
      - persist_to_workspace:
          root: /home/circleci/
          paths:
            - project

workflows:

  default-workflow:
    jobs:
      - custom-checkout
      - path-filtering/filter:
          requires:
            - custom-checkout
          name: Filter workflows
          mapping: |
            .*.py test-back true
          base-revision: fast-track
          config-path: .circleci/workflows/default-workflows.yml
          workspace_path: /home/circleci/

Expected behavior:
Attach workspace and avoid project cloning.
Thanks!! :)

I've added it to our backlog

For reference, please notice how it was solved in the Continuation Orb: https://github.com/CircleCI-Public/continuation-orb/pull/36/files


Cannot install pylint

Environment data
VS Code version:  1.19.2
Python Extension version:
Python Version:   3.4.4
OS and version:    Windows 10, version 1709
Actual behavior
I run the following command to install pylint.
& "C:\Python34\python.exe" -m pip install -U pylint
Expected  behavior
Steps to reproduce:

type  & "C:\Python34\python.exe" -m pip install -U pylint

Logs
Output from Python output panel
Collecting pylint
  Downloading pylint-1.8.2-py2.py3-none-any.whl (689kB)
    8% |##                              | 61kB 499kB/s eta 0:00:02Exception:
Traceback (most recent call last):
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\basecommand.py", line 215, in main
    status = self.run(options, args)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\commands\install.py", line 324, in run
    requirement_set.prepare_files(finder)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\req\req_set.py", line 380, in prepare_files
    ignore_dependencies=self.ignore_dependencies))
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\req\req_set.py", line 620, in _prepare_file
    session=self.session, hashes=hashes)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\download.py", line 821, in unpack_url
    hashes=hashes
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\download.py", line 659, in unpack_http_url
    hashes)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\download.py", line 882, in _download_http_url
    _download_url(resp, link, content_file, hashes)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\download.py", line 603, in _download_url
    hashes.check_against_chunks(downloaded_chunks)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\utils\hashes.py", line 46, in check_against_chunks
    for chunk in chunks:
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\download.py", line 571, in written_chunks
    for chunk in chunks:
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\utils\ui.py", line 141, in iter
    self.next(n)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\_vendor\progress\__init__.py", line 73, in next
    self.update()
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\_vendor\progress\bar.py", line 41, in update
    self.writeln(line)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\_vendor\progress\helpers.py", line 68, in writeln
    print(line, end='', file=self.file)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\_vendor\colorama\ansitowin32.py", line 141, in write
    self.write_and_convert(text)
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\_vendor\colorama\ansitowin32.py", line 169, in write_and_convert
    self.write_plain_text(text, cursor, len(text))
  File "C:\Python34\lib\site-packages\pip-9.0.1-py3.4.egg\pip\_vendor\colorama\ansitowin32.py", line 175, in write_plain_text
    self.wrapped.flush()
OSError: raw write() returned invalid length 132 (should have been between 0 and 66)
    8% |##                              | 61kB 499kB/s eta 0:00:02

Output from Console window (Help->Developer Tools menu)

I tried running as admin as well but didn't help

This does not seem to be related to the extension or vscode since command is running from command line. Something in OS configuration prevents writing to disk. Virus protection perhaps? Maybe run chkdsk /f to verify disk consistency?

Agreed.

will do. Thank you!


device code auth url 404s

Hi folks,
As per: https://trakt.docs.apiary.io/reference/authentication-devices/code I am trying to use the device code flow to authenticate. But I get stuck at the first hurdle, https://api.trakt.tv/oauth/device/code returns a 404 .. am I doing it wrong or is it broken?
Jess

nevermind I am an idiot..

what was the problem?

Umm, I think I was doing a GET (cos I'd only read the top of the page), and initially failed to see the part further down with the example and the POST info


Allow custom build command

Allow for custom build commands to be specified. package.json's build keeps being the default in case the custom one is empty.
New usage would be open-next build [custom build command].
For example, if we have the customBuild command in our package.json, we will run OpenNext like open-next build customBuild.
I have created the BuildArguments type so new arguments can be added down the line.

@pinarruiz would it work if OpenNext can be called programmatically? And you can do something like this:
import { build } from "open-next";

await build({
  path: ".",
  command: "pnpm build",
  esbuild: {
    external: ["pg"]
  },
});

Hey @fwang, i have just added an appPath argument, using:
import { build } from "open-next/dist/build.js";

await build({
  appPath: "./example/",
  buildCommand: "build",
});

will start the build of the example project, however I am still working on it as it cannot generate de .next/standalone directory, since I have no clue why this is happening some help would be appreciated.

 The change was made based on ur PR.. but I thought it might be easier to copy it over to a new pr instead of merging the conflict :)

Hi @fwang could you link the pr? I just want to see the implementation of it. Thanks!


Sometimes encodeLatency in the GTX 3070 is about 30-40ms, is too long, isn't it?

The answer is in https://github.com/alvr-org/ALVR/issues/831


synonym problem carbon catabolite repression

@kimrutherford pointed out
term name is exact synonym of another term
https://www.ebi.ac.uk/QuickGO/term/GO:0061985
https://www.ebi.ac.uk/QuickGO/term/GO:0045013

@pgaudet I think you touched CCR recently?

I thought it was @ukemi


Include mention of the batch-transcode-video script

As mentioned on Twitter, @nwronski 's batch-transcode-video script should be included as a resource for batch-controlling transcode-video. This is a draft of how and where we could put it in the readme

@JMoVS Oh yeah, I forgot about mentioning that somewhere in the upcoming release. Thanks for reminding me!
OK, let me tinker with the wording for awhile. I may merge your patch and then replace some of it immediately or just write something completely different and reject. (You know how anal-retentive I am. :)
But some form of this is going in and you've found the perfect spot in the "README" for that!

maybe just edit my commits, and then squash and merge but accept the pull (so I show up in the contributors list of the project - which is good for my ego haha :P)

Maybe something like "One example of such script that does allow batch-processing although not with indiviual parameters per individual movie is ... but it does show a good visual representation of progress"

ugh, that still doesn't roll of the tongue super fluidly - I have to admit that...

@JMoVS I'll do something like that so you get on the contributors list. One of these days I need to learn how to edit someone else's commits and then "squash and merge." The truth is that I only ever use about four Git commands. :)

If you do it on github.com directly, there is a drop down button for the pull request where you can select "squash and merge".
If you have a wording you want, you can click the "+" button next to the line, comment it in and I edit my commit or you edit it in there directly on github. Both would work

@JMoVS Wording human-readable text so it 1) carries the meaning you intended and 2) sounds effortless... is really damn hard. It might even be harder than writing the code.  I didn't know that. Sweet! OK, I will try that this time Thanks!

@JMoVS Dammit. Can you see the actual Markdown I put in there? I think GitHub is hiding it.

yes, I do see it!

@JMoVS Oh good. :) OK, hopefully you can see why I requested those changes. In mine we credit Nick by name and we more clearly explain what it is that he's done. Also, the link to his project matches the way I've done links to other projects.

yes, totally agree!

changes should be live in the pull request, right?

@JMoVS You still need the "<" and ">" around the link to Nick's project. Otherwise the link won't be active.

@JMoVS Can you copy and paste the text I sent you?

I did copy and paste but had to do the markdown markup myself as that wasn't copied with it. Should be fine now? (Didn't know about the link thing...)

@JMoVS OK, that looks right. I'll take this patch. If I need any other changes I'll make them post-merge. Thanks!

be sure to squash and merge as you won't want all these tiny commits in there (and you'll get the chance to reword the commit message!)

ah cool, you saw that. Looks phenomenal! Thanks to you for doing this amazing project!

@JMoVS You are very welcome, sir! I'm also adding this to my release notes so you'll get mentioned again. :)


Can not updateError on remote validators

updateError does not seem to apply for remote validators.  The following code does not work.  The error message remains "This value seems to be invalid."
window.ParsleyExtend = {
    asyncValidators: {
        emailallowed: {
        fn: function (xhr) {
            if (xhr.responseJSON.code == 'true') return true;
            window.ParsleyUI.updateError($('#email').parsley(), 'remote', 'That email is already in use');
            return false;
        },
        url: '/invitation/allowed'
    }
}

}

The way to do this is with addMessage. No need to call updateError


Only save config needed for replay of transaction log.

@geirst : please review

tests/search/nearest_neighbor/nearest_neighbor.rb has a similar failure, likely caused by the same issue.


resin config commands don't work on resinOS 2.0

Currently resinOS 2.0 images don't work with some of the resin config
relates somewhat to https://github.com/resin-io/resin-cli/issues/537

I'm going to close this. This is true, but the resin config commands are all pretty nonsensical for OS 2.x right now, and with #715 we're going to be completely changing how config generation etc works to make them meaningful anyway. I don't think this ticket adds anything beyond that.


math quiz wrt #4063

PR Description 📜
@kunjgit I had added Math Quiz wrt issue #4063. Kindly review the PR.

Add your screenshots(Optional) 📸

Thank you soo much for contributing to our repository 💗

Thank you @bhumika-1127 ,for creating the PR and contributing to our GameZone 💗
Review team will review the PR and will reach out to you soon! 😇
Make sure that you have marked all the tasks that you are done with ✅.
Thank you for your patience! 😀

@kunjgit I have already created a readme.md inside the new folder. Kindly re-review.


Documentation link broken..

The link in README.md:
Project Documentation
returns a 404.

Thanks. That link doesn't exist.


docs: Named arguments with @required identical to optional named arguments

As an example: https://docs.flutter.io/flutter/material/PopupMenuButton/PopupMenuButton.html
We have to check the source constructor, whereas the itemBuilder argument could be bold or highlighted to make it stand out.

Good idea, thanks! I've filed this bug with the dartdoc team and will close it on this end.


There was some ratio func can't used in process.extract.

Include: fuzz.UQRatio,fuzz.UWRatio, fuzz.partial_ratio,fuzz.partial_token_sort_ratio, fuzz.token_sort_ratio,fuzz.ratio

It is unclear what's not working with these metrics


--include keyword used in example but --exclude-pattern should be used

--include keyword used in this example
azcopy rm "https://[account].blob.core.windows.net/[container]/[path/to/directory]?[SAS]" --recursive=true --include="*.jpg;*.pdf;exactName"
but I think --exclude-pattern should be used.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0b8fdea6-56be-bad9-6717-6797ef26f02d
Version Independent ID: 3c1b3f42-2e75-4d58-ec45-2b023df7cd02
Content: azcopy remove
Content Source: articles/storage/common/storage-ref-azcopy-remove.md
Service: storage
Sub-service: common
GitHub Login: @normesta
Microsoft Alias: normesta

@tam203 Thanks for your question. We are checking on this and will respond to you soon.

@tam203 Thanks for the feedback! I have assigned the issue to the content author to investigate further and update the document as appropriate.

Thanks @tam203. Yes "include" was incorrect. It should be include-pattern. I've updated the article and that change should appear live after 3:00 Pacific time today.  Thank you!

#please-close


Package API

Hi,
I was wondering if there will be a kind of API to access the information from https://chocolatey.org/packages ? Is anything planned? :>
Greetz

Wrong repository - there is already an API using OData.

Sorry so short an answer. A question like this is better suited for the mailing list. If you want to learn more about the API, search for NuGet package metadata API.
If you still need to file an issue for enhancement, please do so on https://github.com/chocolatey/chocolatey.org

No problem, thanks for he fast reply ;-)


Add support for unpatching deletion of byte arrays

Issue
Automerge supports the Uint8Array typed array for storing binary data in an automerge document. Automerge patcher fed this through the clone method, which caused the resulting value output to not be new Uint8Array([0, 1, 2]) but instead an object with structure { 0: 0, 1: 1, 2: 2 }, resulting in a bad unpatch.
This Fix
This PR fixes this by updating the replacer/reviver function used in unpatch, to mark any Uint8Array's by replacing it by [hardcodedUuid, bytes.toString()]. The reviver then checks the hardcoded UUID, and created a new Uint8Array from the stringified data. This is similar to how the unpatch method currently handles the Date type.
Maybe there's a better way of cloning the Uint8Array rather than replacing/reviving it, but tried to follow current patterns as much as possible. Feel free to provide any feedback on better way's to handle this type!

Thanks for this. Clearly explained with a test, couldn't ask for more.


Split giant font list into bullet points

The giant paragraph listing 132 comma-separated font names is unreasonably difficult for a human being to scan.
This PR converts it to a bulleted list while preserving the alphabetic order.

@microsoft-github-policy-service agree


i got issue with the heap memory, i just did run 3 instances at the same time

Environment = Linux vm.
Ram = 8gb.
Disk = SSD
this is the error text:
<--- Last few GCs --->
[54:0x7f8b6ab15020]  1390140 ms: Mark-sweep 1892.6 (2073.3) -> 1892.5 (2070.3) MB, 866.9 / 0.0 ms  (average mu = 0.873, current mu = 0.658) allocation failure; scavenge might not succeed
[54:0x7f8b6ab15020]  1391861 ms: Mark-sweep 1924.0 (2101.8) -> 1924.0 (2109.3) MB, 1286.3 / 0.0 ms  (average mu = 0.698, current mu = 0.253) allocation failure; scavenge might not succeed
<--- JS stacktrace --->
FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory
[nodemon] app crashed - waiting for file changes before starting..
please if you know how to solve this issue, please help!

Hello,
update the nodejs version to 18 and install linux dependencies.


TypeError: routes is not iterable

I've just installed tuyau and tried to generate using node ace tuyau:generate but I get the error: TypeError: routes is not iterable. My routes are located in a folder in individual folder rather than in one routes.ts file, wondering if that's the reason? Anything I can do to fix?

Can you explain your routes setup a bit more please?
If you can also send the output of noce ace list:routes --json please

Try adding this code somewhere and give me the output please:
const router = await this.app.container.make('router')
router.commit()

console.log(router.toJSON())

Alternatively, try looking at this issue: https://github.com/Julien-R44/tuyau/issues/8 You may be facing the same problem.
And also if you can make a minimal reproduction, it would be ideal to be able to help you :)

I thought this may be related to having routes in a folder but I created a new project from scratch and moved the routes.ts and the types are generated successfully so it doesn't appear to be that.

I reviewed #8 and can confirm I'm already using subpath imports.

Please provide a reproduction otherwise I can't help :/

Closing since not actionnable. Feel free to re-open the issue with a proper reproduction


Fixing lift doors not updated after renaming the levels

In the current traffic editor, when the user renames a building level, the lift doors do not update and the lift doors on the old levels still remain in the .building.yaml file. This update should fix this problem. I have tested on my own computer and everything looks fine.

Just changed the pointers to references.

Now my checkers are both running and pass!

Nice! How did you get them to run on your fork?

To be honest I am not sure. I ran the checker locally once and then it started working when I pushed


Adding the Imagenette dataset

This adds a wrapper to import and use Jeremy Howard's Imagenette dataset in testing image classification models within this project. It follows the template of the other image classification datasets, and can be swapped into the current benchmarking infrastructure.
This also adds an example application where SqueezeNet v1.1 is trained using Imagenette.
No on-demand data processing pipeline has been implemented in this project, so all images are loaded and kept in memory. These images are also stored as float tensors, which can lead to exhaustion of memory on systems with less than 16 GB of RAM available.
This implementation is based on work started by Ayush Agrawal and it addresses issue #237.

I'm getting this error:
$ swift run -c release SqueezeNet-Imagenette
Fetching https://github.com/kylef/Commander.git
Fetching https://github.com/kylef/Spectre.git
Cloning https://github.com/kylef/Spectre.git
Resolving https://github.com/kylef/Spectre.git at 0.9.0
Cloning https://github.com/kylef/Commander.git
Resolving https://github.com/kylef/Commander.git at 0.9.1
[5/5] Linking SqueezeNet-Imagenette
Downloading Imagenette dataset...
Archive missing, downloading...
Archive downloaded, processing...
Unarchiving completed
Fatal error: Unexpectedly found nil while implicitly unwrapping an Optional value: file /swift-base/tensorflow-swift-apis/Sources/TensorFlow/Core/TensorHandle.swift, line 128
Current stack trace:
0    libswiftCore.so                    0x00007f0edaea2cb0 swift_reportError + 50
1    libswiftCore.so                    0x00007f0edaf145f0 _swift_stdlib_reportFatalErrorInFile + 115
2    libswiftCore.so                    0x00007f0edac14625 <unavailable> + 1476133
3    libswiftCore.so                    0x00007f0edac14147 <unavailable> + 1474887
4    libswiftCore.so                    0x00007f0edac13e13 <unavailable> + 1474067
5    libswiftCore.so                    0x00007f0edac137a0 _assertionFailure(_:_:file:line:flags:) + 519
6    SqueezeNet-Imagenette              0x000055c3f7475af9 <unavailable> + 203513
7    SqueezeNet-Imagenette              0x000055c3f7475bdf <unavailable> + 203743
8    SqueezeNet-Imagenette              0x000055c3f7475590 <unavailable> + 202128
9    SqueezeNet-Imagenette              0x000055c3f7470fbe <unavailable> + 184254
10   SqueezeNet-Imagenette              0x000055c3f7471b6b <unavailable> + 187243
11   SqueezeNet-Imagenette              0x000055c3f746f9d5 <unavailable> + 178645
12   SqueezeNet-Imagenette              0x000055c3f7729fb5 <unavailable> + 3039157
13   libc.so.6                          0x00007f0ecfba5ab0 __libc_start_main + 231
14   SqueezeNet-Imagenette              0x000055c3f7469b7a <unavailable> + 154490
Illegal instruction (core dumped)
$

My Colab session crashes when I try to load the dataset (and nothing else).
Output:
Downloading Imagenette dataset...
Archive missing, downloading...
Archive downloaded, processing...
Unarchiving completed
tcmalloc: large alloc<PHONE_NUMBER> bytes == 0x68d2c000 @  0x7f397703e1e7 0x7f39758f33d2 0x7f39758f3442 0x7f3975647ab5 0x7f397567cf9d 0x7f397564b80e 0x7f397742b7ed 0x7f3977428f76 0x7f3977428a5b 0x7f39774288d5 0x7f3977396d10 0x400480 0x400480 0x7f3977497c98
tcmalloc: large alloc<PHONE_NUMBER> bytes == 0xb2d2c000 @  0x7f397703e1e7 0x7f39758f33d2 0x7f39758f3442 0x7f3975647ab5 0x7f397567cf9d 0x7f397564b80e 0x7f397742b7ed 0x7f3977428f76 0x7f3977428a5b 0x7f39774288d5 0x7f3977396d10 0x400480 0x400480 0x7f3977497c98
tcmalloc: large alloc<PHONE_NUMBER> bytes == 0x7f37857fa000 @  0x7f397703e1e7 0x7f39758f33d2 0x7f39758f3442 0x7f3975647ab5 0x7f397567cf9d 0x7f397564b80e 0x7f397742b7ed 0x7f3977428f76 0x7f3977428a5b 0x7f39774288d5 0x7f3977396d10 0x400480 0x400480 0x7f3977497c98
tcmalloc: large alloc<PHONE_NUMBER> bytes == 0x7f3534ffa000 @  0x7f397703e1e7 0x7f39758f33d2 0x7f39758f3442 0x7f3975647ab5 0x7f397567cf9d 0x7f397564b80e 0x7f397742b7ed 0x7f3977428f76 0x7f3977428a5b 0x7f39774288d5 0x7f3977396d10 0x400480 0x400480 0x7f3977497c98
tcmalloc: large alloc<PHONE_NUMBER> bytes == 0x7f3365c00000 @  0x7f3977020b6b 0x7f3977040379 0x7f393dca9bf7 0x7f393dc56c3e 0x7f393d3518d5 0x7f393d351c89 0x7f3972b21be2 0x7f3972b16e22 0x7f3972b01883 0x7f3972b23e70 0x7f3972b23e93 0x7f3972c734de 0x7f397564c5e6 0x7f3972b233bd 0x7f397742ba40 0x7f3977428f76 0x7f3977428a5b 0x7f39774288d5 0x7f3977396d10 0x400480 0x400480 0x7f3977497c98
Process killed

https://colab.research.google.com/drive/1WSGbPepc1q-HEfYfCjAY_4qGMxiQXjB2

It does work with a scaled version:
let imagenette = Imagenette(inputSize: .resized160, outputSize: 160)

But not the full version:
let imagenette = Imagenette()

@rickwierenga - Yeah, that's due to memory exhaustion, which we see on all but the largest VMs. We're working on better pipelining for the dataset, and wanted to have this in there first as a "before" case to make sure things worked and to compare with our later optimizations. Might not be able to use this iteration of the dataset on Colab or machines with less than 16 GB of RAM.

I was trying to train a model on Imagenette but the validation accuracy is only 0.005 and it doesn't change at all during training. I told Ayush on the Google Code In platform, but also wanted to share it here. I copied the code from my CIFAR10 ConvNet Notebook which did work, and only changed the dataset^1. The training accuracy is very close to 10% and it also doesn't change at all during training. Are we sure all labels are loaded correctly? 10% is exactly the accuracy you would get by guessing randomly.
Here is the Colab: https://colab.research.google.com/drive/1WhcGye-Tqjzp0NMQgUUfK6e7IMNc5B8l
^1 I'm planning on improving the model for this dataset, but wanted to get something working first.

@rickwierenga - It's possible that there's something off in the labels or other part of the dataset, but the dataset trains with MobileNet and with other networks in my tests. The model not converging could be due to problems with the input shape, how the model is initialized, the learning rate, or a number of factors.
If you swapped in this dataset for CIFAR-10, are you sure that the images are being downsampled properly to be loaded by your network that originally was taking in 32x32 images? Was the original network designed around a 0.0 - 1.0 colorspace range, or 0.0 - 255.0? Was normalization used in your original implementation? All of the above can play a role in a network not training in the same way. It can be a tricky thing to debug.


When clicked on CLA SIGNED link in github, user is redirected to EascyCLA landing page and contributor has no way to view the signed document

Background

Launch github repository
Login as individual contributor
Update file and create pr
Click on CLA NOT SIGNED
Click on Individual
Click on OPEN CLA
Complete docu sign process
User is redirected to github and CLA checks passed
Click on CLA SIGNED.
Observed that user is redirected to Easy CLA landing page. Also observed that contributor does not get any notification with the signed document. There is no way for the contributor to check the signed document

Closing issue due to lack of activity. The current developer landing page has the CLA agreements for viewing and downloading.


support IBM cloud object storage from the dashboard

I have added support for IBM Cloud Object Storage (COS) in multi-cloud, but found that the dashboard didn't pick it up automatically. So I made the modifications needed to add support for COS in the dashboard.
I have included some modifications to the Dockerfile script, removing an unnecessary copy (although I wanted to remove the need to update all the image file layers when you modify a single file, like entrypoint.sh).
I modified entrypoint.sh to support the new version of nginx, which moves the configurations to /etc/nginxs/conf.d. Probably, the first echo and the last cat of the file could be removed.
Finally, I added the svg logo for COS.

Thanks @acorbellini !  We'll take a look.

@wisererik Can you ask zhangpengchong to take a look?

@xing-yang  @acorbellini Sure

@wisererik @acorbellini
There is no problem with the modified parts, but two files[home.component.ts/home.component.html] need to be modified so that they can be displayed on the home page.

@acorbellini Well done!

@jimccfun I have assigned u the write access, then u can merge it after it's LGTY.

@jimccfun I have modified the home component to show the ibm cos cloud


content/environments: mobile kitchens are factory-built food trucks

Metaphor I thought of.

Thanks! That's perfect.


Localized hint covers text

I propose using a "?" instead of "hint". It can get really long (allusione in italian)

Please move it pxt-minecraft.

This is a PXT issue.

We are tracking all user facing issues in their target

All targets are impacted by this bug.

Moved to https://github.com/Microsoft/pxt-minecraft/issues/566


WAL Log Not Compacting After Snapshot

Note: for reported bugs, please fill in the following details. bug reports without detailed steps on how to reproduce will be automatically closed.

Dragonboat version
3.2.8
Expected behavior
Expecting WAL with PebbleDB to compact after Snapshotting.
Actual behavior
It does not appear that the WAL compacts ever. I ran a large enough load test on a 3 node / process cluster running on my development Mac that eventually filled the disk completely. It wasn't even possible to delete files. I had to reboot to free up some disk space so that I could delete the PebbleDB WAL logs.
I added logging to my snapshotting code...
WARN[0084] Dec  3 13:05:07.481502000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0084] Dec  3 13:05:07.481523000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0084] Dec  3 13:05:07.484007000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is 885869770
WARN[0084] Dec  3 13:05:07.484024000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0084] Dec  3 13:05:07.484075000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is 885869770
WARN[0084] Dec  3 13:05:07.484098000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0084] Dec  3 13:05:07.488356000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 4.318785ms
WARN[0084] Dec  3 13:05:07.488410000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 4.313136ms
WARN[0085] Dec  3 13:05:07.521470000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0085] Dec  3 13:05:07.523337000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is 885869769
WARN[0085] Dec  3 13:05:07.523350000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0085] Dec  3 13:05:07.526876000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 3.518845ms
WARN[0096] Dec  3 13:05:18.923764000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0096] Dec  3 13:05:18.925574000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0096] Dec  3 13:05:18.925590000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0096] Dec  3 13:05:18.930094000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 4.494046ms
WARN[0096] Dec  3 13:05:18.937993000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0096] Dec  3 13:05:18.939505000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0096] Dec  3 13:05:18.939519000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0096] Dec  3 13:05:18.944310000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 4.784278ms
WARN[0096] Dec  3 13:05:19.053852000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0096] Dec  3 13:05:19.064988000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0096] Dec  3 13:05:19.065015000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0096] Dec  3 13:05:19.069520000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 4.502988ms
WARN[0108] Dec  3 13:05:30.851621000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0108] Dec  3 13:05:30.853430000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0108] Dec  3 13:05:30.853445000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0108] Dec  3 13:05:30.858827000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 5.371486ms
WARN[0108] Dec  3 13:05:30.882149000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0108] Dec  3 13:05:30.884022000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0108] Dec  3 13:05:30.884039000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0108] Dec  3 13:05:30.888981000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 4.939675ms
WARN[0108] Dec  3 13:05:30.960826000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0108] Dec  3 13:05:30.962559000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0108] Dec  3 13:05:30.962573000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0108] Dec  3 13:05:30.967921000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 5.337168ms
WARN[0119] Dec  3 13:05:42.293330000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0119] Dec  3 13:05:42.295541000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0119] Dec  3 13:05:42.295559000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0119] Dec  3 13:05:42.302124000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 6.549879ms
WARN[0120] Dec  3 13:05:42.644760000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0120] Dec  3 13:05:42.646794000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0120] Dec  3 13:05:42.646811000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0120] Dec  3 13:05:42.653431000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 6.609562ms
WARN[0120] Dec  3 13:05:43.004613000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0120] Dec  3 13:05:43.006518000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0120] Dec  3 13:05:43.006536000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0120] Dec  3 13:05:43.012994000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 6.4517ms
WARN[0131] Dec  3 13:05:53.794408000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0131] Dec  3 13:05:53.805212000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0131] Dec  3 13:05:53.805230000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0131] Dec  3 13:05:53.812846000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 7.598356ms
WARN[0131] Dec  3 13:05:54.108714000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0131] Dec  3 13:05:54.110414000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0131] Dec  3 13:05:54.110427000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0131] Dec  3 13:05:54.118722000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 8.280904ms
WARN[0131] Dec  3 13:05:54.219610000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0131] Dec  3 13:05:54.221433000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0131] Dec  3 13:05:54.221447000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0131] Dec  3 13:05:54.229209000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 7.749574ms
WARN[0143] Dec  3 13:06:05.915555000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0143] Dec  3 13:06:05.917438000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0143] Dec  3 13:06:05.917452000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0143] Dec  3 13:06:05.926135000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 8.670892ms
WARN[0144] Dec  3 13:06:06.855846000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0144] Dec  3 13:06:06.857667000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0144] Dec  3 13:06:06.857690000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0144] Dec  3 13:06:06.866358000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 8.66585ms
WARN[0144] Dec  3 13:06:06.884854000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0144] Dec  3 13:06:06.904235000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0144] Dec  3 13:06:06.904258000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0144] Dec  3 13:06:06.913431000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 9.159226ms
WARN[0154] Dec  3 13:06:17.334577000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0154] Dec  3 13:06:17.336469000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0154] Dec  3 13:06:17.336485000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0154] Dec  3 13:06:17.346031000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 9.534638ms
WARN[0155] Dec  3 13:06:18.400891000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0155] Dec  3 13:06:18.401140000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0155] Dec  3 13:06:18.403155000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0155] Dec  3 13:06:18.403173000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0155] Dec  3 13:06:18.412343000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 9.158987ms
WARN[0155] Dec  3 13:06:18.422037000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0155] Dec  3 13:06:18.422055000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0155] Dec  3 13:06:18.431830000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 9.758411ms
WARN[0166] Dec  3 13:06:29.277614000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0166] Dec  3 13:06:29.279512000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-2/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0166] Dec  3 13:06:29.279527000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0166] Dec  3 13:06:29.289601000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 10.062588ms
WARN[0167] Dec  3 13:06:30.147168000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0167] Dec  3 13:06:30.147482000<EMAIL_ADDRESS>192  Snapshot: Persist
WARN[0167] Dec  3 13:06:30.149168000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-1/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0167] Dec  3 13:06:30.149187000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0167] Dec  3 13:06:30.149512000<EMAIL_ADDRESS>313  Snapshot: Persist: Dirsize for /var/tickie/cluster/local-server-0/raft/dragonboat/db is<PHONE_NUMBER>
WARN[0167] Dec  3 13:06:30.149526000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: starting
WARN[0167] Dec  3 13:06:30.159857000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 10.662336ms
WARN[0167] Dec  3 13:06:30.159889000<EMAIL_ADDRESS>313  DBBadgerSnapshot.Backup: took 10.358491ms
Steps to reproduce the behavior

disable auto-compaction is definitely false...

Auto LogDB compaction just mark log entries as removed, users will have to call NodeHost.RequestCompaction to actually reclaim the disk spaces.
As such NodeHost.RequestCompaction operation can be very I/O intensive, Dragonboat doesn't start it immediate after auto LogDB compaction.
Had a quick look at the godoc, some improvements on that is possible, will do it this week when I have time.

Yes. The log above is from RSM. I'll do another run tomorrow to get Dragonboat Logs.
I cleaned the data from that run to give me disk space, but the current content of that dir (which is I believe the NodeHostDir) is this...
 It's kindof a glorified disk-backed cache. It's content is streamed into snapshots however. So if it were growing out of control it would look like a very large snapshot. And snapshotting would slow down.

Yes, /var/tickie/cluster/local-server-0/raft/dragonboat/db is indeed the NodeHostConfig.NodeHostDir directory.
Could you please check what are the sizes of those logdb-* and snapshot-part-* subdirectories under /var/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001? Thanks.

i finally got around to doing another cluster run. Here are the logdb sizes for one of the three raft nodes.
du -sm /tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/*
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-0
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-1
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-2
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-3
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-4
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-5
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-6
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-7
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-8
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-9
4789	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-10
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-11
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-12
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-13
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-14
1	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-15
4	/tmp/tickie/cluster/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/snapshot-part-10

It's worth noting that this is the view after a benchmarking test that ran about 200QPS for 3-4 minutes. It looks to me like the raft was backing up. The process eventually failed catastrophically.

I ran this again with a single node RAFT. And I ran it with much lower TPS. The log10 eventually backed up again.
du -sm /var/tickie/single/local-server-0/raft/dragonboat/db/*/00000000000000000001/*
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-0
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-1
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-2
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-3
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-4
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-5
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-6
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-7
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-8
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-9
60547	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-10
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-11
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-12
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-13
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-14
1	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/logdb-15
31	/var/tickie/single/local-server-0/raft/dragonboat/db/Jeremys-MBP.hsd1.ca.comcast.net/00000000000000000001/snapshot-part-10

The examples show a "done" channel in the SaveSnapshot function, but do not use it. My code (copy and pasted from somewhere) has this channel labeled as "abort". Can you clarify the purpose of this channel and the proper way to use it?
From https://github.com/lni/dragonboat-example/blob/master/helloworld/statemachine.go
// SaveSnapshot saves the current IStateMachine state into a snapshot using the
// specified io.Writer object.
func (s *ExampleStateMachine) SaveSnapshot(w io.Writer,
	fc sm.ISnapshotFileCollection, done <-chan struct{}) error {
	// as shown above, the only state that can be saved is the Count variable
	// there is no external file in this IStateMachine example, we thus leave
	// the fc untouched
	data := make([]byte, 8)
	binary.LittleEndian.PutUint64(data, s.Count)
	_, err := w.Write(data)
	return err
}

Switching to rocks fixes it.

First of all, the Pebble support in v3.2.8 is experimental, it uses an old version of pebble explicitly marked as not suitable for production use.
If you run the current master version, e.g. using the checkdisk tool I mentioned before, you can keep running that for ages and won't see any spike on disk usage. On my Linux dev box, I use the following cmds to run the checkdisk tool -
$ cd ~/src/dragonboat
$ make tools
using pebble based log storage
go build github.com/lni/dragonboat/v3/tools/checkdisk
$ ./checkdisk -num-of-clients 128 -num-of-clusters 16 -seconds-to-run 600 -checkpoint-interval 100000 -tiny-memory

it creates 16 raft clusters with 128 clients keep accessing them. it takes snapshot every 100,000 proposals and the -tiny-memory flag tells the tool to use less memory for pebble's memtable. I left it there running for a while and check the du results  and the disk usage is minimum - less than 500MBytes were used.
$ cd checkdisk-data-safe-to-delete/
$ du -sm
411	.
$ du -sm
389	.
$ du -sm
391	.

For what you have reported, you haven't ruled out the fact that the disk usage is high when most of those used spaces were probably preallocated for pebble's WAL files. Can you restart your system from the very beginning and see what is the disk usage a few seconds after the restart? It will also be useful to check what files actually taking 80GB of your disk space.

i will check. but in another run they were > 20GB. You can see in https://github.com/lni/dragonboat/issues/146#issuecomment-739561578 that i'm using the default / recommended LogDBFactory function for pebble: pebble.NewLogDB.

@jkassis to support your claim, please provide a minimum program that can reproduce the reported problem. in this case, it can be a simple console program that keeps making proposals and snapshots with a NOOP RSM. Please use the exact same version and configuration for pebble/dragonboat to show that pebble log file can actually increase to 16GBytes each when making regular size proposals.

i switched from the v3.2.6 branch to the master branch and this logsize issue seems to have gone away. I noticed that when starting the cluster, the raft was taking about 800MB of disk right away. Now at least when I start with pebble on master the raft takes a very reasonable 1MB of disk. However, I see see a significant RAFT throughput problem using pebble. With raft, my application can run around 1500 txns / sec. But when I switch to pebbledb, i can't even get 100 txns / sec. I have a 10sec timeout on my raft proposals and the proposals are failing due to this timeout.

I noticed that when starting the cluster, the raft was taking about 800MB of disk right away.

probably caused by WAL preallocation.

However, I see see a significant RAFT throughput problem using pebble.

Are you running on your macbook pro? RocksDB doesn't properly fsync the writes on MacOS, it gives people the false feeling that it is "faster", pebble on the other hand does fsync() properly and thus "slower".


How to use webpack

I cloned the repo. Ran npm i, tns install and then npm run start-android-bundle.
I get:
ERROR in Error encountered resolving symbol values statically. Calling function 'ɵmakeDecorator', function calls are not supported. Consider replacing the function or lambda with a reference to an exported function, resolving symbol Injectable in<EMAIL_ADDRESS>resolving symbol ɵf in<EMAIL_ADDRESS>resolving symbol ɵf in<EMAIL_ADDRESS>and
ERROR in ./main.aot.ts
Module not found: Error: Can't resolve './app.module.ngfactory' in '/home/lukas/WebstormProjects/sample-Groceries/app'
 @ ./main.aot.ts 3:0-60

along with a warning
WARNING in ../~/resolve-url-loader!../~/nativescript-css-loader!../~/nativescript-dev-webpack/platform-css-loader.js!./app.css
      resolve-url-loader cannot operate: CSS error
     /sample-Groceries/app/app.css:6:37: property missing ':'
      at error (/sample-Groceries/node_modules/css/lib/parse/index.js:62:15)

Can someone please hint what am I doing wrong.

+1


Check for header auth token on persistent file download

Purpose
With the addition of the new shiny persistent file download route (#8107), users couldn't provide an oauth token as they used to in order to authenticate for download requests. Let's fix that!
Changes

add check in _get_current_user method to look for token. This is eventually called from the @collect_auth decorator
test for getting with token in header

QA Notes

I do believe that @TimErrington was the one who reported this bug because of a script he runs regularly, so perhaps this would be best tested by him!
Side Effects
Any route using the get_user method from core.py can now pass a token in the header, which is nice!
Ticket
https://openscience.atlassian.net/browse/PLAT-741

Yes, happy to test this when ready. Just let me know

Good to merge when Travis shows green.


Allow freedom in choosing different parametrization

It would be nice to allow users input injection parameters or prior parameters in any parametrization, while keeping options for what parameters to be sampled in. Similarly, allowing users to access the posteriors in any parameters would be handy.

Duplicate of #98.


Kindly Notice

The official site of chartjs in Chinese is 404 except its index page.

Would it be possible for you to include a video of the problem?

here is the link to my netdisk/cloud storage(not sure how to say it in En XD).
Actually I an wondering that if you does have a official website for Chinese developers, as you can see in the video, there are two different website offering so called chartjs guidance to us, all of them seems much alike your En version site.
I'm not asking you providing a Official version to us, after all a coder should have great ability to speak English. However a fake Chinese website may do harm to the reputation to chartjs, that's what a concern.
many thanks!
https://pan.baidu.com/s/1B_n9M3zvp5VqINMfnSBdEw
If link failed, let me know.
website No.1: https://chartjs.bootcss.com/
website No.2: http://chartjs.cn/

We don't provide any website / docs in Chinese because it would be impossible for us to maintain (see #4281). I'm not sure what we can do about the links you posted.

I can understand, thx for your reply and sorry for any copyright issue caused by them, maybe you can add some notice into the docs? many thx, maybe one day I'd be a translator for chartjs.

I emailed<EMAIL_ADDRESS>to inform them of the broken links. Unfortunately I think that's about all we can do since we didn't create these sites and don't control them
Thank you for letting us know about these sites


Release notes button isn't obvious

I wanted to see the release notes for Xcode 15.3 but I didn't see a button in the info pane, so this being an open source project I forked the repo to add a button.
Then when I looked at the code I realized the 🔗 button is the release notes button I was planning on adding.
Now I know what the button does, but I obviously didn't understand it at first glance, and I didn't hover long enough to see the help tip either. So instead of adding a Release Notes button this PR replaces the 🔗 with text, to make it more discoverable
I don't know if this is the best solution, but I thought I'd share the idea and see what you think.
This approach also adds one more string to localize. I was able to copy out the pertinent bit of the ReleaseNotes.help string for a few of the romantic and germanic languages, but there are a few others left to do. I could look into doing those too if we decide to move forward with the text idea. (Or just use the help text directly, including the "see" part and not add a new string at all.)
PR

Released

🤔 agree the 🔗 icon may not be (at first glance) easy to understand. I was trying to keep it clean, so I think having that full release button goes against that.
Perhaps changing the icon - to a 🗒  or something would help?

I agree that the full text isn't as clean, so I understand why you went with the 🔗. I'm not sure if any other icon would be any more obvious, but the 🗒 might be.
I also considered making the 'Release Notes' text smaller and removing the button border so it would have a cleaner look, but I'm not sure if that would be any better since it would then just look like text. Do you think underlined text would look clean enough? I'm not sure if I like the idea of using web style in a native app though. 🤔


DANGER: Robot Teleportation

I am controlling UR10 with ROS2 driver given in this repository.
When I Estop the robot and start it back, I experience robot teleportation (the robot moves with a very high speed and then it stops because the robot controller detects internal collision)
The exact steps I followed are:

Run ROS2 Driver and MoveIt2 Script on the PC
Run Ext_Ctrl URCap on the UR robot
Set a goal position in Rviz
Plan the trajectory using 'Plan' in Rviz
Execute the trajectory using 'Execute' in Rviz
Estop the robot (on the Teach Pendent) before the trajectory is completed
Remove the Estop and activate the robot from Teach Pendent
Play the ext_ctrl URCaps on Teach Pendent
Robot Teleportation
Robot stops as the robot controller detects internal collision and stops the robot

This is very dangerous move (more specifically for a collaborative robot). I don't know if it is because I am using it in wrong way or a bug. But, it needed to be fixed as it is dangerous.
https://user-images.githubusercontent.com/37081073/196284134-495079b3-17da-498e-920b-d52fa2efc6ed.mp4

With the information giving, I believe that your planner is keep sending targets to the robot without knowing that the robot is stopped and not moving.
May I ask which controller you are using?
I will strongly suggest that you are using the scaled_joint_trajectory_controller as this loops pack the speed-scale of the robot including pausing the trajectory execution if the robot program is Emergency or safeguard stopped as well as pause

Closing this as a solution was proposed quite some time ago and we never heard back.


How to do multi head attention, but the shape of q, k, and v is different?

The SCA moudle adopt semantic features form clip and text features form clip, the Q is only from text, K and V are added by text and image. And your picture in the paper shows that the Q, K, V have different shape, so how to do Q@K? Is this is your SCA code?
    def forward(self, img, text_emb):         if self.clip_norm:             img = (img + 1) / 2             img = F.batch_norm(img, self.mean.to(self.device),                                self.std.to(self.device))             img = F.interpolate(img, (224, 224))         image_features = self.model(img)         if self.last_layer_proj:             image_features = torch.einsum('bld,ds->bls', image_features,                                           self.model.proj)         if self.cross_attn is not None:             emb_features = self.cross_attn(                 text_emb.permute(0, 2, 1),                 image_features.permute(0, 2, 1)).permute(0, 2, 1)         if self.skip_module is not None:             if self.learned_length:                 residual = self.skip_module(emb_features.permute(0, 2, 1))                 residual = residual.permute(0, 2, 1)             else:                 residual = self.skip_module(emb_features)             text_emb += residual         return text_emb

Thanks for your issue.  Indeed, there is a distinct dimensionality associated with the length of Q, and K and V. When applying the attention mechanism, the Q@K operation occurs in the width dimension, where they align. For example, the operation is as follows: (batch, length_m, dimension) @ (batch, length_n, dimension) -> (batch, length_m, length_n). You can find an implementation of cross-attention here:
https://github.com/Taited/sgdiff/blob/12487a10556a41647a857e5d9fe3f7d310f0c196/mmagic/models/editors/sgdiff/clip_modules.py#L103


[firebase_auth]: handleSignInWithApple EXC_BAD_ACCESS (KERN_INVALID_ADDRESS)

Is there an existing issue for this?

[X] I have searched the existing issues.

Which plugins are affected?
Auth
Which platforms are affected?
iOS
Description
A crash is happening when trying to sign in with Apple on my iOS live app with firebase_auth and using the AppleAuthProvider class.
Reproducing the issue
I have no idea how to reproduce it since it happened only to my live users and i have tested the Sign in With Apple multiple times after without any success to reproduce the issue...
Here is the code i am calling in my released app to sign in with Apple :
Future<bool> signInWithApple() async {
    AppleAuthProvider appleAuthProvider = AppleAuthProvider();
    appleAuthProvider.addScope("email");
    appleAuthProvider.addScope("fullName");
    try {
       UserCredential? userCredential = await FirebaseAuth.instance.signInWithProvider(appleAuthProvider);
       return userCredential != null;
    } catch (error) {
       print("Error sign in with Apple $error");
    }
    return false;
}

Firebase Core version
3.8.1
Flutter Version
3.24.5
Relevant Log Output
Crashed: com.apple.main-thread
0  Runner                         0x5a8614 handleSignInWithApple + 369 (FLTFirebaseAuthPlugin.m:369)
1  Runner                         0x5a8724 __78-[FLTFirebaseAuthPlugin authorizationController:didCompleteWithAuthorization:]_block_invoke_2 + 433 (FLTFirebaseAuthPlugin.m:433)
2  FirebaseAuth                   0x1985c thunk for @escaping @callee_unowned @convention(block) (@unowned ActionCodeInfo?, @unowned NSError?) -> () + 68 (<compiler-generated>:68)
3  FirebaseAuth                   0x28678 partial apply for thunk for @escaping @callee_guaranteed (@guaranteed AuthDataResult?, @guaranteed Error?) -> () + 24 (<compiler-generated>:24)
4  FirebaseAuth                   0x2963c partial apply for specialized closure #1 in static Auth.wrapMainAsync<A>(callback:withParam:error:) + 40
5  FirebaseAuth                   0xd4c4 thunk for @escaping @callee_guaranteed () -> () + 28
6  libdispatch.dylib              0x2370 _dispatch_call_block_and_release + 32
7  libdispatch.dylib              0x40d0 _dispatch_client_callout + 20
8  libdispatch.dylib              0x129e0 _dispatch_main_queue_drain + 980
9  libdispatch.dylib              0x125fc _dispatch_main_queue_callback_4CF + 44
10 CoreFoundation                 0x56204 __CFRUNLOOP_IS_SERVICING_THE_MAIN_DISPATCH_QUEUE__ + 16
11 CoreFoundation                 0x53440 __CFRunLoopRun + 1996
12 CoreFoundation                 0x52830 CFRunLoopRunSpecific + 588
13 GraphicsServices               0x11c4 GSEventRunModal + 164
14 UIKitCore                      0x3d2eb0 -[UIApplication _run] + 816
15 UIKitCore                      0x4815b4 UIApplicationMain + 340
16 UIKitCore                      0x7bbfa8 block_destroy_helper.23 + 10212
17 Runner                         0x91e0 main +<PHONE_NUMBER> (AppDelegate.swift:4333703648)
18 ???                            0x1af672ec8 (Missing)

Flutter dependencies

Expand Flutter dependencies snippet

Dart SDK 3.5.4
Flutter SDK 3.24.5
login 0.0.1

dependencies:
- connectivity_plus 6.1.0 [flutter flutter_web_plugins connectivity_plus_platform_interface web meta nm collection]
- firebase_app_check 0.3.1+7 [firebase_app_check_platform_interface firebase_app_check_web firebase_core firebase_core_platform_interface flutter]
- firebase_auth 5.3.4 [firebase_auth_platform_interface firebase_auth_web firebase_core firebase_core_platform_interface flutter meta]
- firebase_core 3.8.1 [firebase_core_platform_interface firebase_core_web flutter meta]
- flutter 0.0.0 [characters collection material_color_utilities meta vector_math sky_engine]
- google_sign_in 6.2.2 [flutter google_sign_in_android google_sign_in_ios google_sign_in_platform_interface google_sign_in_web]

dev dependencies:
- flutter_lints 5.0.0 [lints]
- flutter_test 0.0.0 [flutter test_api matcher path fake_async clock stack_trace vector_math leak_tracker_flutter_testing async boolean_selector characters collection leak_tracker leak_tracker_testing material_color_utilities meta source_span stream_channel string_scanner term_glyph vm_service]

transitive dependencies:
- _flutterfire_internals 1.3.47 [collection firebase_core firebase_core_platform_interface flutter meta]
- args 2.6.0
- async 2.11.0 [collection meta]
- boolean_selector 2.1.1 [source_span string_scanner]
- characters 1.3.0
- clock 1.1.1
- collection 1.18.0
- connectivity_plus_platform_interface 2.0.1 [flutter meta plugin_platform_interface]
- dbus 0.7.10 [args ffi meta xml]
- fake_async 1.3.1 [clock collection]
- ffi 2.1.3
- firebase_app_check_platform_interface 0.1.0+41 [_flutterfire_internals firebase_core flutter meta plugin_platform_interface]
- firebase_app_check_web 0.2.0+3 [_flutterfire_internals firebase_app_check_platform_interface firebase_core firebase_core_web flutter flutter_web_plugins web]
- firebase_auth_platform_interface 7.4.10 [_flutterfire_internals collection firebase_core flutter meta plugin_platform_interface]
- firebase_auth_web 5.13.5 [firebase_auth_platform_interface firebase_core firebase_core_web flutter flutter_web_plugins http_parser meta web]
- firebase_core_platform_interface 5.3.1 [collection flutter flutter_test meta plugin_platform_interface]
- firebase_core_web 2.18.2 [firebase_core_platform_interface flutter flutter_web_plugins meta web]
- flutter_web_plugins 0.0.0 [flutter characters collection material_color_utilities meta vector_math]
- google_identity_services_web 0.3.3 [meta web]
- google_sign_in_android 6.1.33 [flutter google_sign_in_platform_interface]
- google_sign_in_ios 5.7.8 [flutter google_sign_in_platform_interface]
- google_sign_in_platform_interface 2.4.5 [flutter plugin_platform_interface]
- google_sign_in_web 0.12.4+3 [flutter flutter_web_plugins google_identity_services_web google_sign_in_platform_interface http web]
- http 1.2.2 [async http_parser meta web]
- http_parser 4.0.2 [collection source_span string_scanner typed_data]
- leak_tracker 10.0.5 [clock collection meta path vm_service]
- leak_tracker_flutter_testing 3.0.5 [flutter leak_tracker leak_tracker_testing matcher meta]
- leak_tracker_testing 3.0.1 [leak_tracker matcher meta]
- lints 5.0.0
- matcher 0.12.16+1 [async meta stack_trace term_glyph test_api]
- material_color_utilities 0.11.1 [collection]
- meta 1.15.0
- nm 0.5.0 [dbus]
- path 1.9.0
- petitparser 6.0.2 [meta]
- plugin_platform_interface 2.1.8 [meta]
- sky_engine 0.0.99
- source_span 1.10.0 [collection path term_glyph]
- stack_trace 1.11.1 [path]
- stream_channel 2.1.2 [async]
- string_scanner 1.2.0 [source_span]
- term_glyph 1.2.1
- test_api 0.7.2 [async boolean_selector collection meta source_span stack_trace stream_channel string_scanner term_glyph]
- typed_data 1.4.0 [collection]
- vector_math 2.1.4
- vm_service 14.2.5
- web 1.1.0
- xml 6.5.0 [collection meta petitparser]

Additional context and comments
No response

So far i have received 4 crashes on 4 different phones :


Neurology: Traumatic Brain Injury (TBI) - Missing Usage, Source and References

@linophth @preston I apologize for all the GitHub entries. I think that once we get over the hump with a handful of artifacts the rest will be a breeze. The issues that are arising are consistent, so we just need to figure out an approach moving forward.
It seems like the mulitmodal artifacts tend to be without Usage, Source, and References. This is probably because they are really comprised of several artifacts. For clarity, I suggest that we still populate these 3 fields for viewers who go directly to a multimodal artifact, instead of looking at all of the components first.
I would be happy to populate the Usage details based upon what is listed in the White Paper, add the primary source (e.g., Derived from xxx White Paper) and the References that are associated with each group of artifacts.  Please let me know if you would like me to proceed or wait to have you update the XML then reload the multimodal artifacts via the API.
I don't mind making the updates - they are easy, but I don't want to interfere with your process.
Thanks,
Sharon

I would love it if you made the updates, since the learning curve would slow me down.  Let's see if Preston agrees.  I can't figure out how to assign this to him????

I would love it if you made the updates, since the learning curve would slow me down. Let's see if Preston agrees

I think we need to let Preston make the call on technical workflow – I’m happy with whatever he decides.
Linda Wedemeyer, MD, RN, MS
Physician Informatician, Clinical Decision Support
Knowledge Based Systems
Office of Informatics & Analytics
Mobile<PHONE_NUMBER>
Los Angeles, CA
From: ssebast2<EMAIL_ADDRESS>Sent: Friday, November 30, 2018 2:24 PM
To: OSEHRA/vha-kbs-knarts<EMAIL_ADDRESS>Cc: Wedemeyer, Linda<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: [EXTERNAL] Re: [OSEHRA/vha-kbs-knarts] Neurology: Traumatic Brain Injury (TBI) - Missing Usage, Source and References (#463)
@prestonhttps://github.com/preston Is it okay if I go ahead and manually add Source and Reference entries to the TBI and Neurosurgery artifacts so I can get them published?
Moving forward, for artifacts not already uploaded to the Repository, we can revisit the workflow (i.e., you can update the XML and re-upload if you prefer or I can manually add the Source and Reference). Just let me know your preference.
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/OSEHRA/vha-kbs-knarts/issues/463#issuecomment-443357852, or mute the threadhttps://github.com/notifications/unsubscribe-auth/Akhg1Q5B6c-21nS9jJoZbR582Fzj7Dzkks5u0a_5gaJpZM4Y4vO5.

I think we need to let Preston make the call on technical workflow – I’m happy with whatever he decides.

Roger that. I am happy to do whatever is decided.

@preston Is it okay if I go ahead and manually add Source and Reference entries to the TBI and Neurosurgery artifacts so I can get them published?
Moving forward, for artifacts not already uploaded to the Repository, we can revisit the workflow (i.e., you can update the XML and re-upload if you prefer or I can manually add the Source and Reference). Just let me know your preference.

@ssebast2 If you want to edit the white paper XML (not the Word or PDF copy directly), either on master or via a pull request (PR), myself or @fcuello can rerender the PDFs that CDS Connect posts. As long as @linophth is ok with the changes themselves I am good with you making the XML changes!

@preston I am proposing that I type an entry "response" in to the repository Source and Reference fields. The responses would align with what is in the white paper. If I do this, there is no need to adjust the XML at all. It is a work around to finish up the 3 multi-modal artifacts that are pending publishing.
I am requesting approval for me to manually add metadata responses. That is a quick, easy and accurate approach to the concern. However, if you prefer that the XML upload file be the source of truth for the multi-modal artifact uploads, then we will need someone to add responses for these fields. I am open to either approach. Just let me know.
If it is easier to discuss over the phone, my work cell is:<PHONE_NUMBER>. I am free this afternoon, except between 3-4pm ET. Thanks!!

@Fcuello Could you take a look at this?


Finishing examples/covariance

@pbeckman Adding this issue as a place to keep track of discussion related to finishing up everything in examples/covariance.
run_lbo_cov.sh
I ran this with OBJ_PATH=.../armadillo2.obj and FRACTION=0.125 so that it didn't take so long compared to the default choice of parameters. Here's the output:
~/Dropbox/Research/Butterfly/butterfly/builddir/examples/covariance $ ./run_lbo_cov.sh
triangle mesh with 10812 verts
streaming 1351 eigenpairs
row tree with depth 9
set up FEM discretization [0.0s]
maximum eigenvalue: lambda = 45.7133 [0.5s]
freq tree with depth 6
feed: bracket = (-inf, 0.01), num. eigs = 35
feed: bracket = [0.01, 0.04), num. eigs = 104
truncation error estimate after 139 eigenpairs is 9.83e-01
feed: bracket = [0.04, 0.10), num. eigs = 158
truncation error estimate after 297 eigenpairs is 9.62e-01
feed: bracket = [0.10, 0.18), num. eigs = 207
truncation error estimate after 504 eigenpairs is 9.33e-01
feed: bracket = [0.18, 0.28), num. eigs = 250
truncation error estimate after 754 eigenpairs is 8.87e-01
feed: bracket = [0.28, 0.40), num. eigs = 294
truncation error estimate after 1048 eigenpairs is 8.34e-01
feed: bracket = [0.40, 0.55), num. eigs = 321
finished streaming BF (actually factorized 1369 eigenpairs):
  time spent streaming eigenbands: 121.5s
  time spent building BF: 3.3s
  compressed   size: 58.0 MB
  uncompressed size: 112.9 MB
  untruncated  size: 891.9 MB
  compression  rate: 1.9
computing 100 samples
drew 100 samples [0.6s]
computing marginal covariance
computing 100 matvecs with covariance
saving random vectors and matvecs

./exact_cov_test.sh
Doesn't seem to matter which mesh I run this on, I hit the issue described here: https://github.com/sampotter/butterfly/issues/9
./fast_cov_test.sh
This issue: https://github.com/sampotter/butterfly/issues/10.

cheb_cov.c seems to be working with mass lumping, but when I turn off mass lumping I get some cholCsrReal initialization errors. For a minimal example run
./cheb_cov bunny0.obj 1e-4 0 10 32 0

My backtrace is
* thread #1, queue = 'com.apple.main-thread', stop reason = EXC_BAD_ACCESS (code=1, address=0x0)
  * frame #0: 0x0000000100528c50 libbutterfly.dylib`bfCholCsrRealInit(cholCsrReal=0x000000012c804200, mat=0x000000012b6065d0) at chol_csr_real.c:143:24
    frame #1: 0x0000000100003338 cheb_cov`main(argc=7, argv=0x000000016fdfed50) at cheb_cov.c:191:5
    frame #2: 0x000000019d0960e0 dyld`start + 2360

From what I can tell, cholCsrReal->impl is uninitialized (i.e. is NULL). So when we try to write to cholCsrReal->impl->A at src/chol_csr_real.c:143 we have issues.

@pbeckman Can we close this out in favor of the other to-do list issue?

Yep, that sounds good. I'll turn my above comment into its own issue.


hex's virus in a nutshell

please leave memes OUT of the github issue page.

stop being a boomer

eef


Module 6 Lab Unit 7 Task 4 Typo for Name of Firewall

Module: 06
Unit 7 Lab
Task: 4
Step: 3
Description of issue
When creating a Firewall resource, it states “Virtual Machine Name” when it should just be “Name”
Cheers,
Jeff Smalley MCT
Chicagoville

MOC Labs Review did not experience this issue.


Add NPU FusedAdam support

Add NPU FusedAdam support.

@tjruwase @jeffra @RezaYazdaniAminabadi @cmikeh2 Sorry for annoying, can you guys review this PR ?

@tjruwase Good day. This PR is approved and ready to be merged. Could you retrigger this workflow and merge it? Thanks :-)

@CurryRice233, it is best to use this guide for formatting issues: https://github.com/microsoft/DeepSpeed/blob/master/CONTRIBUTING.md#prerequisites

@CurryRice233, it is best to use this guide for formatting issues: https://github.com/microsoft/DeepSpeed/blob/master/CONTRIBUTING.md#prerequisites

Thank you, new skill get😉.  By the way, could you retrigger this workflow again?

@tjruwase hi, could you retrigger this workflow again and merge it? Thanks😀