feat: add resiliency to importconfig routines

Recently introduced corrupt entries at the Z-Wave Alliance DB cause importConfig to fail in some instances. These changes add 0x9999 placeholders to missing productId or productType entries, and if present, inserts a TODO warning in a comment at the top of the device file.
I went with a placeholder instead of putting "Unknown" or something there, as using a string would require a bunch of refactoring due to the number of different places we enforce the format and use that value to lookup manufacturer names and such.

Will try to look at this tomorrow when the kids are asleep and I have some time to kill

Will try to look at this tomorrow when the kids are asleep and I have some time to kill

Sounds good. This is fully tested now. Running the Yale locks I had a variety of conforming and non-conforming files, and after a fix or two this now works as pushed.

Sorry, one more thing.
Use !== instead of !=. The only exception is checking against null/undefined.

Sorry, one more thing. Use !== instead of !=. The only exception is checking against null/undefined.

Done

@AlCalzone We need to sort parameters but only where they didn't come from an original file. Ideas? Right now for a new import they end up 1, 11, 12, 2, 21, etc. I can sort them retaining the comments, but then it clobbers if we had a file manually sorted to begin with.

@AlCalzone We need to sort parameters but only where they didn't come from an original file. Ideas? Right now for a new import they end up 1, 11, 12, 2, 21, etc. I can sort them retaining the comments, but then it clobbers if we had a file manually sorted to begin with.
I could maybe add a dummy key if it is a new file (which would get stripped out in normalizeConfig, and only sort in normalizeConfig if it is there?

@AlCalzone Ok, please look at my solution. It works fine. I've tested this and it preserves the sort order for existing documents (both regular and partial params), preserves comments in existing files, and sorts new files by parameter number.

I debated that. I'm not sure how likely it is. If you're worried about it, I can also populate a key when I set 0x9999 (sort of like I did with the search) and use that to trigger the warning. Then it would only trigger if we'd set the 0x9999 versus it coming from the db.


Inliner replaces '&' with '&' in inconvenient places

How can we reproduce this bug?
Create any email with images that contain an '&' in the src or that implements html entities
Write out the HTML (or Inky code) that causes the issue.

Read More >>
What did you expect to happen?
The inline would ignore src attributes/link attributes, as well as existing html entities
What happened instead?
A lot of my markup was destroyed. All images broke and html entities I used were broken
What email clients does this happen in?
Any client

Think this is related to this issue #560.
Instead of using the "Copy to clipboard" button try triple clicking the code so it selects it all (better than scrolling down the page) and copying it (cmd+c/ctrl+c).

Thanks for reporting @Sparxoo, we'll close this thread and reference #560 as @marcpartridge pointed out. Looking to resolve this soon!

"Copy to Clipboard" btn is still causing this issue as of now. Just FYI.


[WIP] mame: 0.215 -> 0.216

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Notify maintainers
cc @

Going to add module

@GrahamcOfBorg build mame

@Lassulus thank you!


feat: edit schema

:tada: This PR is included in version 1.0.0 :tada:
The release is available on:

GitHub release
1.0.0

Your semantic-release bot :package::rocket:


[terra-table] Allow consumers to hide table column headers

Summary

What was changed:
The Terra Table component was updated to allow consumers to control the visibility of column headers in the table.
Why it was changed:
The change was made to maintain passivity with existing implementations that requires the column headers to be hidden such as the Stella Timeline.
Testing

This change was tested using:

[X] WDIO
[X] Jest
[ ] Visual testing (please attach a screenshot or recording)
[ ] Other (please describe below)
[ ] No tests are needed

Reviews
In addition to engineering reviews, this PR needs:

[X] UX review
[ ] Accessibility review
[ ] Functional review

Additional Details
N/A
This PR resolves:
UXPLATFORM-9638

Thank you for contributing to Terra.
@cerner/terra

@cm9361  Functionally it looks good, confirmed no headers are read in JAWS as well.

It gets the header info now! Thanks Charles. One last thing is the header cells shouldn't have buttons since they can't be accessed by anyone without a screen reader.

It gets the header info now! Thanks Charles. One last thing is the header cells shouldn't have buttons since they can't be accessed by anyone without a screen reader.

Thank you for the feedback, @eawww.  I need the logic from upcoming PRs to remove the button.  I would not want to add that to this PR to prevent merge conflicts.  What I can do is make the cell be 'not selectable'.  This should give the desired behavior once the JIRAs in-flight are merged.  Would that be acceptable?

@cm9361 could you point me to the jira or PR removal of the button is slated on?

@cm9361 could you point me to the jira or PR removal of the button is slated on?

https://github.com/cerner/terra-framework/pull/1836/files#diff-6e67623f4efab392deb44bd2b292882500459c61651ae61d911cd8dbd01bc775R271


How to enable mTLS within two namespaces

I have two services in different namespaces let's say namespacea and namespaceb  so how can I restrict that only services in  namespacea can access to services in  namespaceb using an Authz Policy sources with namespaces
I have been following these Authz policy examples

https://istio.io/latest/docs/ops/configuration/security/security-policy-examples/#namespace-isolation
https://istio.io/latest/docs/tasks/security/authentication/mtls-migration/
But stills throws me 403 error since I have checked that the request header from my service on  namespacea is missing the  x-forwarded-client-cert  since ssl is none.

I know within the same namespace the services can communicate using the namespace Authz isolation but if they are in different namespaces I face this issue.
I also have set the DestinationRule for service in  namespaceb an set ttls mode ISTIO_MUTUAL and PeerAuthentication for both namespaces are  in PERMISSIVE.
So my questions are how to enable the mTLS for both ns?,  how can I specify that my service in  namespacea has to use mTLS when sending the request to service in  namespaceb in other words to send the ssl or the spiffe token
I am using istio on default profile
Update
I have done some testing and notice when I use the service ip or DNS of the service the header is present on the request but if I use the pod ip is not present.
What can cause this problem when using pod ip?

so how can I restrict that only services in namespacea can access to services in namespaceb using an Authz Policy sources with namespaces

You can create authorizationPolicy in namespaceb like this
Please show what is your config look like

Hey @hzxuzhonghu
Thanks for replying
now my issue is that my service used the pod ip to reach my service in namespaceb but as far I know istio is a service mesh so I am not able to use istio capabilities please note I have sidecar containers on both services , so my question would be is there any way to make istio to integrate pod IP into the mesh?


azure-eventhubs unit testing - how to mock/patch receive events (on_event Callback)

Package Name: azure-eventhubs
Package Version: 5.0.0
Operating System: alpine3.11
Python Version: python:3.8

Describe the bug
While unit testing of the program that use azure-eventhubs, I was not able to test on_event Callback function using mock/patch
To Reproduce
The Sample Program
  def receive_events(receive_duration=15):
        received_events = []

        def on_event(partition_context, event):
            # Code to drop the events on some conditions
            logger.info("Accepting the event")
            received_events.append({"message": event.body_as_str(encoding='UTF-8'),
                                    "properties": event.properties})
            partition_context.update_checkpoint(event)

        try:
            thread = threading.Thread(
                target=consumer_client.receive,
                kwargs={
                    "on_event": on_event,
                    "starting_position": "-1",
                }
            )
            thread.start()
            time.sleep(receive_duration)
            consumer_client.close()
            thread.join()
        return received_events

The Sample Test Case
from unittest.mock import MagicMock
from unittest.mock import patch

@patch('azure.eventhub.EventHubConsumerClient.from_connection_string')
@patch('azure.eventhub.extensions.checkpointstoreblob.BlobCheckpointStore.from_connection_string')
    def test_eventhub_receive_events(self,
                                     mock_blob_checkpoint_store,
                                     mock_event_hub_consumer_client):
        mock_event_hub_consumer_client.return_value = MagicMock()
        mock_blob_checkpoint_store.return_value = MagicMock()
        with self.assertLogs('myprogram', level='INFO') as assert_execute:
            received_events()
        self.assertIn("Accepting the event", assert_execute.output)

Expected
Callback method on_event should get triggered during Unit Test execution using Mock/Patch, but currently it is not getting triggered.

Hey prabdeb; thanks for reaching out.
While I can't claim familiarity with MagicMock/Patch, my immediate question when reading this is twofold.

If you want to test on_event, why not just test it directly?  I would assume simply mocking the inputs to it would be more feasible.
Why would you expect on_event to be called in the code you've provided?  To actually trigger that natively would require either a more full integration test, or for you to reach your hands very deep inside the internals to plumb an event through, which seems unrealistic.

Don't hesitate to let me know if I've misunderstood any aspects of your question or samples.

@prabdeb The following code should work. I defined method receive, which calls the callback on_event, for mock object mock_event_hub_consumer_client.
Let me know if you have more question.
import threading
import time
import logging
logger = logging.getLogger("myprogram")
logger.setLevel(logging.INFO)
def receive_events(consumer_client, receive_duration=15):
    received_events = []
    def on_event(partition_context, event):
        # Code to drop the events on some conditions
        logger.info("Accepting the event")
        received_events.append({"message": event.body_as_str(encoding='UTF-8'),
                                "properties": event.properties})
        partition_context.update_checkpoint(event)
    thread = threading.Thread(
        target=consumer_client.receive,
        kwargs={
            "on_event": on_event,
            "starting_position": "-1",
        }
    )
    thread.start()
    time.sleep(receive_duration)
    consumer_client.close()
    thread.join()
    return received_events

from unittest.mock import MagicMock
from unittest.mock import patch
from azure.eventhub.extensions.checkpointstoreblob import BlobCheckpointStore
from azure.eventhub import PartitionContext, EventData
import unittest
class TestStringMethods(unittest.TestCase):
    @patch('azure.eventhub.EventHubConsumerClient.from_connection_string')
    @patch('azure.eventhub.extensions.checkpointstoreblob.BlobCheckpointStore.from_connection_string')
    def test_eventhub_receive_events(self, mock_blob_checkpoint_store, mock_event_hub_consumer_client):
        mock_event_hub_consumer_client.return_value = MagicMock()
        mock_blob_checkpoint_store.return_value = MagicMock()
        def receive(on_event, **kwargs):
            partition_context = MagicMock()
            partition_context.update_checkpoint = MagicMock()
            on_event(partition_context, EventData("test for Mock"))
        mock_event_hub_consumer_client.receive = receive
        with self.assertLogs('myprogram', level='INFO') as assert_execute:
            receive_events(mock_event_hub_consumer_client)
        self.assertIn("Accepting the event", assert_execute.output[0])
if __name__ == '__main__':
    unittest.main()

Thanks a lot @YijunXieMS it is now working as expected, is it possible to have this documented as a sample test case, so that it will be useful for future use?

@prabdeb Thanks for the suggestion. I'm closing this issue now and will follow-up with the sample test case separately.


Can't open External PDF URL

Link to PDF file (or attach file here):
http://vrinsoft.com/terratrove/upload/chapter/PDF1459862116.pdf
Configuration:

Web browser and its version: I am using for Phonegap Application(Android/iOS)
Operating system and its version:
PDF.js version:
Is an extension: no

Steps to reproduce the problem:

Open https://mozilla.github.io/pdf.js/web/viewer.html from my Application
Load External URL of PDF

What is the expected behavior? (add screenshot)
PDF should be visible and also enable pinch zoom
What went wrong? (add screenshot)
I can't open

PDF
Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):
https://mozilla.github.io/pdf.js/web/viewer.html

@Krishna25Vrinsoft Hi bro did you got the solution to open external URL in this pdf viewer?

Do you get errors/warnings in the console? Most likely you're trying to request a file from storage that the app does not have access to, but without any logs this is impossible to tell from the description alone.


Update ember cli & migrate to ember-native-dom-helpers

Most of the work is courtesy of https://github.com/cibernox/ember-native-dom-helpers-codemod

oh god, I forgot we still had circleci on this

@bcardarella Removing circle-ci then.


Upgrade to Next.js 14

NOTES:

Next 13 by default uses React Server Component, which breaks MUI. So we need to explicitly add string "use client";  until MUI resolves the issue here
Next14 has been released late October, so we're 2 major versions behind now
We should migrate to use the new app router instead of page router as well (guide)

RESOURCES:

https://github.com/mui/material-ui/issues/34905#issuecomment-1326535989

Set 5 points, since we need to follow the migration guide, migrate existing routes to the new app router, and make sure marking components with "use client" doesn't somehow break MUI or somehow miss marking "use client" at some places causing page specific runtime error

Reading migration guide now to make sure the upgrade can be done efficiently. E.g., using code mods where possible

Created a new ticket to capture the need to incrementally migrate all routes:
https://app.zenhub.com/workspaces/single-cell-5e2a191dad828d52cc78b028/issues/gh/chanzuckerberg/single-cell-data-portal/6496
This ticket will start the migration with some examples

Looks like other people are struggling with the upgrade as well:
https://github.com/emotion-js/emotion/issues/2928#issuecomment-1889817340
I think I'll just keep the routes in pages for now

Will have a followup PR to tackle Google Font and Metadata using the new Next.js API


Add "Math" and "Science" category in .quiz

Description
Since the .quiz command currently only has the "General" category which is pretty much only geography and history questions, we propose to add "Math" and "Science", 30 (or more) questions each which would be randomly picked.
Reasoning
Because it only has "General", and we NEED MORE!
Proposed Implementation
Additional Details
Would you like to implement this yourself?

[ x] I'd like to implement this feature with the cat dev team
[ ] Anyone can implement this feature

https://docs.google.com/document/d/1qIbapQUMLD40s5yzrqXZ7n0-6p1z3azpz1O_rPOWTv4
list of math questions, subject to change

Sounds good! I think the Math and Science categories would go well in this server.

How about a programming category as well, since its a programming server? I wouldn't say python specific questions, more general knowledge of programming mixed in with some actual programming techniques.

that's an incredible idea!!

McPoggers

update: currently have 30 questions in math, 10 questions in science, and 2 in cs. more coming

update: currently have 30 questions in math, 30 questions in science, and 16 in cs/python. also did a revamp of the original code so it's compatible with image urls, multiple possible answers, etc.


Create hns-re2sd.txt

@mehdaoui-A First stage of verification passed, official domain is hns-re2sd.dz as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

@mehdaoui-A Thank you for your patience while waiting for a review and processing your request. Pull request merged.


fixed bug in head_object and delete_object when an empty bucket name is passed

…ssed

Before this is merged I want to find out from Jason how this change will affect folders.  In Spectra S3 we will create folders if you ask for them to be created.  We should see before this is merged what exactly should happen.

That makes total sense. I worried a little bit about that implementing it this way.

So what was the answer on this?

Jason said he couldn't see any way it would be a problem.
On Nov 5, 2015 1:44 PM, "Ryan Moore"<EMAIL_ADDRESS>wrote:

So what was the answer on this?
—
Reply to this email directly or view it on GitHub
https://github.com/SpectraLogic/ds3_c_sdk/pull/72#issuecomment-154202625
.


Add a Jumpbox to dev stacks

An ssh key is created based on the users public key (it assumes the
users public key is available as ~/.ssh/id_rsa.pub), so at the moment connecting to the instance is only available for the user who is applying the jumpbox project.
In order to get the jumpbox to work you will need to ensure that you have jq installed and you allow your ssh key to be forwarded, details of which can be found in the README.
It's be a good idea to start with a fresh stack in order to ensure that your ssh key is being forwarded to the EC2 instance, so if you have an existing stack to destroy it and then apply the terraform to build it again.
To connect to the EC2 instance, rather than jumping onto the jumpbox and then ssh-ing on the the instance the make jump task will do both steps for you, you will just need to give permission to access the jumpbox and EC2 instance once unless the jumpbox / instance IP addresses change.

@ejrowley can you update this PR please?

I don't understand why we using a separate module for this when it should be something that should possibly be used in conjunction with the instances deployment.
We could set a variable that if true the Jump box is deployed. This reduce's the amount of code & complication.

I am just wondering about the private hosted zone that we where going to have internally. The intent was to allow us to jump to the instances more easily using DNS when inside the VPC  ?

I think it is fine for the time being. I cannot seem to see the private DNS name attached to the instance, however this is not the most important things right. Private DNS names are luxury at the moment.

Oh and did we ever get to the bottom of why a new jumpbox is created everytime you run make apply even if you haven't made any code changes? Would be good to avoid that (although I'd be willing to let it slide and put it as a bug ticket given how long this PR has been open)

Had a chat with @ejrowley and it appears that by adding  security_groups to ignore_changes, it should prevent the instance from being destroyed.


After closing the edit history view, only if the node exists, go to the same node, so that the user can continue working on it. Currently, it jumps back to where the user where.

Currently, it jumps back to where the user where and there is no way for the user to go to the node, which was edited other than searching it. We should stay on the edited node. If the user wants to go back to the page where they were previously located, they can easily click the browser's BACK button.
https://github.com/user-attachments/assets/5c48fd21-8ab3-4625-b8c1-ab9432dba136

@somin0016 This issue still exists. Try opening and viewing a user's edit history. After you view one of their edits and close the sidebar, it goes back to the previous node that the user was viewing.


Simulation hangs

Describe the bug
The hello_world example program simulation hangs & times out after 10ms.
To Reproduce

Compile and install latest ghdl
Compile and install latest risc-v gcc toolchain
cd neorv32/sw/example/hello_world
make USER_FLAGS+=-DUART0_SIM_MODE MARCH=rv32imc_zicsr clean_all sim  # Note: User guide section 13.4.1 does NOT specify that "_zicsr" extension needs to be used for the compilation, but I had to add it for the hello_world to compile. I'm unsure if this is an issue on my end or a problem with the documentation.

Console output:
$ make USER_FLAGS+=-DUART0_SIM_MODE MARCH=rv32imc_zicsr clean_all sim
../../../sw/lib/source/neorv32_uart.c: In function 'neorv32_uart_setup':
../../../sw/lib/source/neorv32_uart.c:116:2: warning: #warning UART0_SIM_MODE (primary UART) enabled! Sending all UART0.TX data to text.io simulation output instead of real UART0 transmitter. Use this for simulations only! [-Wcpp]
116 | #warning UART0_SIM_MODE (primary UART) enabled! Sending all UART0.TX data to text.io simulation output instead of real UART0 transmitter. Use this for simulations only!
|  ^~~~~~~
Memory utilization:
text	   data	    bss	    dec	    hex	filename
3760	      0	    116	   3876	    f24	main.elf
Compiling ../../../sw/image_gen/image_gen
Installing application image to ../../../rtl/core/neorv32_application_image.vhd
Simulating neorv32_application_image.vhd...

Copyright (C) 2003 - 2023 Tristan Gingold.
GHDL is free software, covered by the GNU General Public License.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
RISC-V GCC -
$ riscv32-unknown-elf-gcc -v
Using built-in specs.
COLLECT_GCC=riscv32-unknown-elf-gcc
COLLECT_LTO_WRAPPER=/opt/riscv/libexec/gcc/riscv32-unknown-elf/13.2.0/lto-wrapper
Target: riscv32-unknown-elf
Configured with: /home/david/prj/repos/riscv-gnu-toolchain/gcc/configure --target=riscv32-unknown-elf --prefix=/opt/riscv --disable-shared --disable-threads --disable-tls --enable-languages=c,c++ --with-system-zlib --with-newlib --with-sysroot=/opt/riscv/riscv32-unknown-elf --disable-libmudflap --disable-libssp --disable-libquadmath --disable-libgomp --disable-nls --disable-tm-clone-registry --src=.././gcc --disable-multilib --with-abi=ilp32 --with-arch=rv32i --with-tune=rocket --with-isa-spec=20191213 'CFLAGS_FOR_TARGET=-Os    -mcmodel=medlow' 'CXXFLAGS_FOR_TARGET=-Os    -mcmodel=medlow'
Thread model: single
Supported LTO compression algorithms: zlib
gcc version 13.2.0 (GCC)
OS GCC -
$ gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/13/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-redhat-linux
Configured with: ../configure --enable-bootstrap --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-shared --enable-threads=posix --enable-checking=release --enable-multilib --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-gcc-major-version-only --enable-libstdcxx-backtrace --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --enable-plugin --enable-initfini-array --with-isl=/builddir/build/BUILD/gcc-13.2.1-20231205/obj-x86_64-redhat-linux/isl-install --enable-offload-targets=nvptx-none --without-cuda-driver --enable-offload-defaulted --enable-gnu-indirect-function --enable-cet --with-tune=generic --with-arch_32=i686 --build=x86_64-redhat-linux --with-build-config=bootstrap-lto --enable-link-serialization=1
Thread model: posix
Supported LTO compression algorithms: zlib zstd
gcc version 13.2.1 20231205 (Red Hat 13.2.1-6) (GCC)
NEORV32 Git Hash (fresh checkout of main branch) -   8f3a2c3068ce087a6b46c998742d64f2388541d5
From the hello_world directory:
make check
---------------- Check: NEORV32_HOME folder ----------------
NEORV32_HOME: ../../..
---------------- Check: Shell ----------------
/bin/sh
/usr/bin/bash
---------------- Check: riscv32-unknown-elf-gcc ----------------
Using built-in specs.
COLLECT_GCC=riscv32-unknown-elf-gcc
COLLECT_LTO_WRAPPER=/opt/riscv/libexec/gcc/riscv32-unknown-elf/13.2.0/lto-wrapper
Target: riscv32-unknown-elf
Configured with: /home/david/prj/repos/riscv-gnu-toolchain/gcc/configure --target=riscv32-unknown-elf --prefix=/opt/riscv --disable-shared --disable-threads --disable-tls --enable-languages=c,c++ --with-system-zlib --with-newlib --with-sysroot=/opt/riscv/riscv32-unknown-elf --disable-libmudflap --disable-libssp --disable-libquadmath --disable-libgomp --disable-nls --disable-tm-clone-registry --src=.././gcc --disable-multilib --with-abi=ilp32 --with-arch=rv32i --with-tune=rocket --with-isa-spec=20191213 'CFLAGS_FOR_TARGET=-Os    -mcmodel=medlow' 'CXXFLAGS_FOR_TARGET=-Os    -mcmodel=medlow'
Thread model: single
Supported LTO compression algorithms: zlib
gcc version 13.2.0 (GCC)
---------------- Check: riscv32-unknown-elf-objdump ----------------
GNU objdump (GNU Binutils) 2.42
Copyright (C) 2024 Free Software Foundation, Inc.
This program is free software; you may redistribute it under the terms of
the GNU General Public License version 3 or (at your option) any later version.
This program has absolutely no warranty.
---------------- Check: riscv32-unknown-elf-objcopy ----------------
GNU objcopy (GNU Binutils) 2.42
Copyright (C) 2024 Free Software Foundation, Inc.
This program is free software; you may redistribute it under the terms of
the GNU General Public License version 3 or (at your option) any later version.
This program has absolutely no warranty.
---------------- Check: riscv32-unknown-elf-size ----------------
GNU size (GNU Binutils) 2.42
Copyright (C) 2024 Free Software Foundation, Inc.
This program is free software; you may redistribute it under the terms of
the GNU General Public License version 3 or (at your option) any later version.
This program has absolutely no warranty.
---------------- Check: NEORV32 image_gen ----------------
NEORV32 executable image generator
Three arguments are required.
1st: Operation
-app_bin : Generate application executable binary (binary file, little-endian, with header)
-app_img : Generate application raw executable memory image (vhdl package body file, no header)
-raw_hex : Generate application raw executable (ASCII hex file, no header)
-raw_bin : Generate application raw executable (binary file, no header)
-bld_img : Generate bootloader raw executable memory image (vhdl package body file, no header)
2nd: Input file (raw binary image)
3rd: Output file
4th: Project name or folder (optional)
---------------- Check: Native GCC ----------------
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/13/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-redhat-linux
Configured with: ../configure --enable-bootstrap --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-shared --enable-threads=posix --enable-checking=release --enable-multilib --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-gcc-major-version-only --enable-libstdcxx-backtrace --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --enable-plugin --enable-initfini-array --with-isl=/builddir/build/BUILD/gcc-13.2.1-20231205/obj-x86_64-redhat-linux/isl-install --enable-offload-targets=nvptx-none --without-cuda-driver --enable-offload-defaulted --enable-gnu-indirect-function --enable-cet --with-tune=generic --with-arch_32=i686 --build=x86_64-redhat-linux --with-build-config=bootstrap-lto --enable-link-serialization=1
Thread model: posix
Supported LTO compression algorithms: zlib zstd
gcc version 13.2.1 20231205 (Red Hat 13.2.1-6) (GCC)
Toolchain check OK
Hardware:
Default testbench HW
Additional context
NA
Thank you! This is an unbelievable project that I've been quietly following for several years now. Now I finally have a use case for this processor, and I'm attempting (and failing) to get the basics up and running. Any help appreciated.

See https://github.com/stnolting/neorv32/blob/main/.github/workflows/Processor.yml#L50-L74. Simulation is meant to be executed with software processor_check because the testbench does expect some specific UART output. Thus, it is not prepared to be simulated with arbitrary software.

BTW, it might be a good idea to enhance the documentation with some explanation and/or to improve the testbench(es) to support execution (simulation) of other software.
I could reply so fast and easily just because @Unike267 did hit this "problem" some weeks ago and I had to check the CI/sources to understand it.

FTR, there is some content already in the UG:

13. Simulating the Processor
13.4.1. Hello World!

Fantastic, thanks for the fast reply. Executing the "run_check.sh" script in the processor_check directory gave the results I'd expect.
So to make sure I'm clear on this, the only program that can be simulated at the HDL level is processor_check? All others can only be run on hardware?  If this is the case, then the UG sections that you linked are either out of date, or misleading because they make it seem like all of the example programs can be simulated with GHDL with their UART output sent to the terminal.  I could definitely be misunderstanding. Apologies if I've missed something in the documentation.

No worries, you are correct. We need to fix the code and/or update the docs. Since I have some spare time today, I'm running some simulations to try catch the problem. So far:

The make sim approach using the arguments described in the docs does fail for either processor_check or hello_world: https://github.com/umarcor/neorv32/actions/runs/7975576648
The CI job that executes the shell script uses doit to compile processor_check, and it does use some different arguments: https://github.com/stnolting/neorv32/blob/main/do.py#L29. Adding USER_FLAGS+=-DUART1_SIM_MODE and EFFORT=-Os and setting rv32ima_zicsr_zifencei instead of rv32imac_zicsr_zifencei makes a difference, since now processor_check passes; but hello_world still fails: https://github.com/umarcor/neorv32/actions/runs/7975739531. However, note that Hello world! :) is printed/shown (https://github.com/umarcor/neorv32/actions/runs/7975739531/job/21774642489#step:4:100), so I believe the problem is in the testbench. The simulation itself is usable if you check the log and ignore the exit code/result.

So, still not clear what specific changes need to be done in the docs and/or in the code, but we are getting slightly closer.

Got it, thanks so much for looking into this.
I copied the "run_check.sh" script into the hello_world dir, and it, and saw the hello world program run correctly. So it appears to have been a problem with the arguments as you alluded to (but it is still returning with exit failure status for me too).
Also BTW, I've seen you all over several other open source FPGA repos, so thanks for all of your contributions to the ecosystem in general.

Hey @davidgussler!
I think this is just a configuration issue. You have compiled your application (hello_world) with the C ISA extension enabled:

Console output:
$ make USER_FLAGS+=-DUART0_SIM_MODE MARCH=rv32imc_zicsr clean_all sim

But the default testbench is configured without the C ISA extension. Your GHDL log also shows the actual hardware configuration:

../../rtl/core/neorv32_cpu.vhd:142:3:@0ms:(assertion note): [NEORV32] CPU ISA: rv32imabu_zicsr_zicntr_zicond_zifencei_zfinx_zihpm_zxcfu_sdext_sdtrig_smpmp

The compiler has generated compressed instructions but the CPU hardware is not capable of executing them so the whole processor hangs in an eternal exception loop.
Just re-compile and re-run your application with the right ISA flags: make USER_FLAGS+=-DUART0_SIM_MODE MARCH=rv32im_zicsr clean_all sim

Note: User guide section 13.4.1 does NOT specify that "_zicsr" extension needs to be used for the compilation, but I had to add it for the hello_world to compile. I'm unsure if this is an issue on my end or a problem with the documentation.

Right, the documentation is not very precise here. _zicsr needs to be in the MARCH string all the time.

So to make sure I'm clear on this, the only program that can be simulated at the HDL level is processor_check?

You can run any program you like using the makefile's sim target. You just might need to adjust the testbench configuration (for example enabling the C extension):
https://github.com/stnolting/neorv32/blob/f4a6365e3827f52dab890f14f422fc54836e1bbb/sim/simple/neorv32_tb.simple.vhd#L174

Thank you! This is an unbelievable project that I've been quietly following for several years now.

Thank you very much! 😃

FTR
The GHDL script that are called by "make sim" were originally designed for running the processor_check program only. At the very end these scripts check for a specific UART string to tell if the simulation was successful. Obviously, this check does not work when simulating any other program (like hello_word) so the Makefile (or more precisely, the GHDL scripts) always return an error after timeout. This is misleading (but not harmful), so we should really fix this 🙈

I suggest we check for some envvar [...]

I was about to pass the folder of the software executable as another argument to the GHDL script and execute the cat-grep only if that is equal to "processor_check"... But your proposal seems to be much cleaner! :+1:

On the other hand, since the default testbench has extension C disabled, we should update the docs and use MARCH=rv32im or MARCH=rv32ima in https://stnolting.github.io/neorv32/ug/#_hello_world. We might need to check it somewhere else.

Good point. I'll update that.

We should probably also add a warning/note about the whole processor hanging in an eternal exception loop if unsupported/unconfigured instructions are used.

Hm, also a good point. But where to put that? Any suggestions?

Last, shall we add some of the example software executions to CI (e.g. hello_world and demo_blink_led) in order to catch these issues in the future?

The demo_blink_led does not output anything via UART - so there is nothing to see there.
If we add "hello_world" to the CI checks then we would also need another "checker" to validate there is some (expected) UART output. Where should we put this?

@stnolting I believe I addressed all the points in #817 and #819, except running hello_world in CI.

Great info. Another enhancement could be to add a readme for each example program that specifies the minimum VHDL generic configuration that's required to run that specific application.

@davidgussler I like that. Yet, instead of a README per subdir, I would suggest a "table" in a single sw/example/march.txt. For instance:
hello_world=rv32imac
processor_check=rv32ima

The point is for the file to be machine-readable, so that we can eventually use it to automate either tests or checks.

@umarcor Much better! I like it. But along with the architecture specification, I think that you would also want to have a way of capturing the optional bus peripherals and any other generic options that could affect the outcome of the simulation.
The easiest way to do this (that is still machine readable) might be have an individual VUnit regression for each test app (where feasible... I know for example, that @stnolting mentioned that some of the apps don't give any uart output), where the python test runner passes the required generics to the TB depending on test that needs to be run. This way, you don't need a table or readme because the simulation configurations are "self-documented" in a way.
Just spit-balling here. I'm not familiar with the inner-workings of this project, so maybe this doesn't fit with project goals / would be too much of a pain to set up.

I'm not really sure if we really need to run all example programs by the CI pipeline. I mean, that would be nice to ensure everything still works after a PR. But maybe this is even impossible as some example programs need explicit user inputs... E.g. how can you check the "demo_twi" program without having a user input that triggers the actual TWI transfers and without having a simulation model of a TWI chip?

I would add just the ones that make sense. If that's just hello_world, it's ok. In the end, that's the one  mentioned in the docs.
With regard to TWI or similar use cases, that should be done with a verification component, so that would be an specific testbench managed by VUnit, instead of the simple testbench.

@davidgussler I'm sorry I had missed https://github.com/stnolting/neorv32/issues/816#issuecomment-1954801302.
I agree. That's the reason for having VUnit in this repo: to handle multiple testbenches from module/unit tests to integration tests. Currently, there are not many testbenches testing each of the peripherals, but I believe it would be welcome to eventually walk there. Some will be rather straightforward (such as the hello_world), others will be more complex (because there might not be Verification Components available for it).
Moreover, we currently build the software and then run the simulation, in separated steps. I believe that's because the sim container did not contain the RISCV GCC at first. That was a separated environment, and therefore a separated step. However, we could make run.py call make and we could have it customised for an specific test or set of tests through the pre hook (http://vunit.github.io/py/ui.html#pre-and-post-simulation-hooks).
If you want to take the task, I believe a good starting point would be a testbench that exposes the cpu extension generics, as you mentioned. Actually, instead of exposing all of them through generics, you might want to consider using JSON-for-VHDL. There is an example at http://vunit.github.io/examples.html#json-for-vhdl which shows how to pass multiple arguments/parameters as either a JSON file or an encoded JSON string. Note that JSON-for-VHDL is synthesisable, so that mechanism might be also used for a single parameterised top-level that is configurable through a JSON file.

@umarcor Got it. No promises on getting to this any time soon, but I'll keep it on my radar.  Especially considering @snolting's last comment where he pointed out that essentially all of the apps should run with the default configuration, it seems like exposing the DUT generics to the python runner may just end up adding more complexity without contributing a worthwhile benefit.
Thanks again for all of the help today. I'll go ahead and close this issue now that the documentation has been updated. I think that a separate issue / enhancement could be created to add the hello_world to the CI suite if that is still something you see as worthwhile.


complete callback

Hi @christiangenco!
We’re using dbinbox (basic plan) iframe for one of our projects and we want to add some notification and tracking if a file transfer is completed or at least the file is added to the queue by user.
For now embedded iframe has no any sort of messaging, though in console there is an object being logged when a file is sent, but that happens within the iframe.
Is it possible to add simple postMessage mechanism to notify about simple events like add, send, progress, complete?
Is there any sense in making a PR for that?
Thanks.

Ooo, this is a good idea. To be clear: do you want this callback in javascript?
The codebase in github has diverged a lot from that actually deployed at http://dbinbox.com so a pull request would be tricky. What would be helpful on my end is if you wrote up what your ideal code would look like on your end for handling the callback, and I'll fiddle with things on my end to get that to work.

Yes, exactly, a javascript callback.
What I expect — in main index.html, where I include iframe, I do:
window.addEventListener('message',function(event) {
	if(event.origin !== 'https://dbinbox.com') return;
	if (event.data === 'add') console.log('file added');
	if (event.data === 'complete') console.log('file sent');
	event.source.postMessage('thanks, lad!', event.origin);
},false);

Basically the behaviour from here.

Okay cool, I can do something like that. I'll send you an email when it's
ready!
Christian.
On Thu, Aug 4, 2016 at 5:44 PM, Dima Yv<EMAIL_ADDRESS>wrote:

Yes, exactly, a javascript callback.
What I expect — in main index.html, where I include iframe, I do:
window.addEventListener('message',function(event) {
if(event.origin !== 'https://dbinbox.com') return;
if (event.data === 'add') console.log('file added');
if (event.data === 'complete') console.log('file sent');
event.source.postMessage('thanks, lad!', event.origin);
},false);
Basically the behaviour from here
http://stackoverflow.com/a/8849807/1052640.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/christiangenco/dbinbox/issues/66#issuecomment-237705926,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAK8oV9D2LGzPWPf6TTcWe0yTYCJMUChks5qcmtCgaJpZM4Jb6Y1
.

Great, thanks a lot!


InputObject and SimpleObject field renaming

Hi,
I wonder if there is a way to rename a field of InputObject or SimpleObject.
I searched quickly, I can only see rename_fields not sure what is the equivalent of rename in serde.
Thanks,

So it appears that I can use serde rename for SimpleObject, I will play around with InputObject, hopefully it works the same.

So it appears that I can use serde rename for SimpleObject, I will play around with InputObject, hopefully it works the same.

If you only want to rename a single field, you can do it like this:
#[derive(SimpleObject)]
struct MyObj {
    #[graphql(name = "abc")
    a: i32,
}

If you only want to rename a single field, you can do it like this:
#[derive(SimpleObject)]
struct MyObj {
    #[graphql(name = "abc")
    a: i32,
}

Thanks it works!

Thanks it works!


feat: add readme

test

Test from Postman

Test from Postman

Test from Postman

Test from Postman

Hello from Github Action

Hello from Github Action

Hello from Github Action. Input param: null

Hello from Github Action. Input param: Intellij

Hello from Github Action. Input param: Intellij

Hello from Github Action. Input param: Intellij

Hello from Github Action. Input param: Intellij

Hello from Github Action. Input param: Intellij

Hello from Github Action. who-to-greet param: Mona the Octocat

Hello from Github Action. who-to-greet param: Mona the Octocat

Hello from Github Action. who-to-greet param: Mona the Octocat


Eliminate direct demand between 2 airports that are too close

Probably within 50km.
Need to consider the case for islands tho

Disallow <= 50km  links


Get verbose logging when deploy azure resources

Package Name: @azure/arm-resources
Package Version: ^4.2.0
Operating system: windows
[x] nodejs

version: v12.16.0

[ ] browser

name/version:

[x] typescript

version: 4.2.2

Is the bug related to documentation in

[ ] README.md
[ ] source code documentation
[ ] SDK API docs on https://docs.microsoft.com

Describe the bug
Hi, are there any method to get verbose log when deploying azure resources? I am using ResourceManagementClient to deploy arm template json file and would like to get verbose process info during deployment. Are there any method to do that?
import {ResourceManagementClient, ResourceManagementModels} from "@azure/arm-resources";

const creds = new DefaultAzureCredential();
const client = new ResourceManagementClient(creds, subscriptionId);

let template = JSON.parse(fs.readFileSync(armTemplateJsonFilePath, "utf8"));
let parameter = JSON.parse(fs.readFileSync(parameterFilePath, "utf8"));
type DeploymentMode = "Incremental" | "Complete";
let deploymentParameters = {
  properties: {
    parameters: parameter,
    template: template,
    mode: "Incremental" as DeploymentMode,
  },
};

const result = await client.deployments.createOrUpdate(
  "myResourceGroupName",
  "myDeploymentName",
  deploymentParameters
);

Since the deployment usually takes quite a long time, I am looking for a method to give detailed process status when the deployment is on the way so user of my tool can have a better control of current status instead of facing blank output, not knowing whether the deployment has been stuck.
Thank you!

@dilin-MS Sorry for late response.
Could you try the following codes to check whether it meets your requirements?

Add import: import {logPolicy} from '@azure/ms-rest-js'
Add a new parameter when creating ResourceManagementClient:

    const client = new ResourceManagementClient(credential,subscriptionId, {
        requestPolicyFactories: (defaultRequestPolicyFactories: RequestPolicyFactory[]) => {
            defaultRequestPolicyFactories.push(logPolicy());
            return defaultRequestPolicyFactories;
        }
    });

thanks

Thanks @dw511214992. Though this is not the log I am seeking for.
I manage to poll deployment status using the list operation of deployment. Add here in case other developers are looking for such a solution:
import {
  ResourceManagementClient,
  ResourceManagementModels,
} from "@azure/arm-resources";

const creds = new DefaultAzureCredential();
const client = new ResourceManagementClient(creds, subscriptionId);

let template = JSON.parse(fs.readFileSync(armTemplateJsonFilePath, "utf8"));
let parameter = JSON.parse(fs.readFileSync(parameterFilePath, "utf8"));
type DeploymentMode = "Incremental" | "Complete";
let deploymentParameters = {
  properties: {
    parameters: parameter,
    template: template,
    mode: "Incremental" as DeploymentMode,
  },
};

let finished = false;
const resourceGroupName = "myResourceGroupName";
const result = await client.deployments
  .createOrUpdate(resourceGroupName, "myDeploymentName", deploymentParameters)
  .then((result) => {
    console.log(
      `Successfully deploy arm template to resource group ${resourceGroupName}.`
    );
    return result;
  })
  .finally(() => {
    finished = true;
  });
let deploymentStartTime = Date.now();
pollDeploymentStatus(client, deploymentStartTime);

async function pollDeploymentStatus(
  client: ResourceManagementClient,
  deploymentStartTime: number
): Promise<void> {
  console.log("polling deployment status...");

  setTimeout(async () => {
    if (!finished) {
      let deployments = await client.deployments.listByResourceGroup(
        resourceGroupName
      );
      deployments.forEach((deployment) => {
        if (deployment.properties.timestamp.getTime() > deploymentStartTime) {
          console.log(
            `[${deployment.properties.timestamp}] ${deployment.name} -> ${deployment.properties.provisioningState}`
          );
          if (deployment.properties.error) {
            console.log(
              `Error message: ${JSON.stringify(
                deployment.properties.error,
                null,
                2
              )}`
            );
          }
        }
      });
      pollDeploymentStatus(client, deploymentStartTime);
    }
  }, 10000);
}

thanks @dilin-MS for your codes. If you want to get the special log in js sdk, you need to write your own requestPolicy (you can check the function logPolicy in my codes as an example). I think it's complex, so if you can achieve the goal with your codes, just use it.
I will close this issue because it seems you don't need other help from my end. You also can reopen it if you have other question.
thanks

Thank you very much!


JSON-to-human schema translator should only insert __cedar on primitive/extension types if necessary

Category
User level API features/changes
Describe the feature you'd like to request
Currently, for any JSON schema containing primitive or extension types (String, Bool, etc), when translating the schema to the human-readable format, the translation will use __cedar::String, __cedar::Bool, etc.  This is only necessary if the schema declares different types String, Bool, etc in the empty namespace or current namespace.  We should detect when this is necessary, and in the (overwhelmingly common) case that __cedar:: is not necessary, the translator should not add it.
Describe alternatives you've considered
Ideally we detect exactly the conditions when this is necessary.  We could instead overapproximate, and e.g., add __cedar:: to all primitive/extension types if the schema defines a type String / Bool / etc anywhere in the schema (in any namespace).
Additional context
No response
Is this something that you'd be interested in working on?

[ ] 👋 I may be able to implement this feature request
[ ] ⚠ This feature might incur a breaking change

Related: #682

I think a better solution is not to have an implementation of the Display trait for Fragment<N>. Instead, we translate it into an AST of the Cedar schema and implement that for the ASTs.


Detailed error check

Added machinery and a csv file to check individual factor error values, checking all 4,467 factor errors in testSpiderWalking by comparing them with stored values in the CSV file tests/testSpiderWalking.csv. This was useful to debug issue #261, but might also allow us to easily explore better initialization strategies (some of which already exist)

@yetongumich This PR exposes that here as well we have differences between Linux and Mac. If you click on a failing Linux check above you can see that the errors are very different on Linux from the one in the CSV file, on my mac. If you are running this on Linux, could you do a valgrind? Asking you as @varunagrawal and @gchenfc are gunning for ICRA...

@danbarla also feel free to run valgrind if you're on Linux. Want to get to the bottom of this - might point to (another) weird bug.

@danbarla I just checked in some regressions on initial values, with expected values from my Mac, and the joint angles and joint velocities do not agree on Linux (used the docker container :-))
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:204: Failure: "expected -1.8499999999999999e-05 but was: 6.0276815148976885e-06"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:205: Failure: "expected 1.9759999999999998e-06 but was: -5.1303190182304889e-07"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:206: Failure: "expected -1.8499999999999999e-05 but was: 6.0276815148976885e-06"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:207: Failure: "expected 1.9759999999999998e-06 but was: -5.1303190182304889e-07"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:209: Failure: "expected -3.8999999999999999e-06 but was: 3.7040939584755143e-06"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:210: Failure: "expected -5.1100000000000002e-06 but was: 2.597843754075192e-06"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:211: Failure: "expected -3.8999999999999999e-06 but was: 3.7040939584755143e-06"
/usr/src/GTDynamics/tests/testSpiderWalking.cpp:212: Failure: "expected -5.1100000000000002e-06 but was: 2.597843754075192e-06"

That confirms my suspicion, and narrows the problem down to the initialization of joint angles/velocities, as Poses seem to agree.

Please have a look at this link:
[https://github.com/imneme/pcg-cpp/issues/50]
there could be a problem with std::normal_distribution when working cross_platform. The order of the sampled values is changed.
actually every pair of values sampled is the same but in the opposite order.
I was able to prove this by adding this line at Sampler.cpp line 43 in GTSAM and recompiling:
      Normal dist(0.0, sigma);       auto res = dist(generator_);       result(i) = dist(generator_);
after this the test passes except line 183 which I think will pass also with the correct init_vals

@dellaert
Please have a look at this link:
[https://github.com/[imneme/pcg-cpp/issues/50](https://github.com/imneme/pcg-cpp/issues/50)]
there could be a problem with std::normal_distribution when working cross_platform. The order of the sampled values is changed.
actually every pair of values sampled is the same but in the opposite order. This happens even though we use the same seed.
I was able to prove this by adding this line at Sampler.cpp line 43 in GTSAM and recompiling:
 Normal dist(0.0, sigma); auto res = dist(generator_); result(i) = dist(generator_);
after this the test passes except line 183 (still not sure why)

Woah, good find!!! That is very annoying behavior :-(
Can you suggest a way to fix it? Or several options?

Actually, we don’t have to fix it: randomness in unit tests is frowned upon, anyway, and is actually not needed here. Rather, can we change the test (and possibly the init code) so we can ask for a sequence with no randomness ?

we could set the gaussian noise to zero. this will just initialize all values to exactly zero.
We could add a boost::optional argument with external initialization to MultiPhaseZeroValuesTrajectory  which will come from a csv file. This can help in testing but it will require writing new code and the real code that runs when there is no external initializaion will not be tested.
We can just not test for specific values here. Is this test different from other tests where we initialize with noise and not check for specific values?

@danbarla I took your zero noise suggestion, implemented it, and merged. I also merged the branch depending on this. Next (after teaching) I will push the branch you and I prototyped in response to the issue I created.


Fix a possible unreleased lock in function block_new

When that allocation failed.

Codecov Report

Merging #54 into master will increase coverage by 0.07%.
The diff coverage is 50%.

@@            Coverage Diff             @@
##           master      #54      +/-   ##
==========================================
+ Coverage   50.26%   50.33%   +0.07%
==========================================
  Files          33       33
  Lines       13432    13433       +1
==========================================
+ Hits         6751     6762      +11
+ Misses       6681     6671      -10

Impacted Files
Coverage Δ

lib/facil/fio.c
58.85% <50%> (+0.22%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 25f1229...b4e3037. Read the comment docs.

Nice catch!
☺🙏🏻🙏🏻👍🏻👏🏻👏🏻👏🏻


added var count and allele frequnecy graphs to Mango notebook

Added new notebook plot functions for:

Allele Frequency Histogram by Functional Consequence
Bar graph of Variant counts by Allele frequnecy

Not yet ready for code review, but wanted to share what the graphs looks like
examples in Mango notebook:
import os

from bdgenomics.adam.adamContext import ADAMContext
from bdgenomics.adam.rdd import AlignmentRecordRDD, CoverageRDD
ac = ADAMContext(spark)
from bdgenomics.mango.QC import VariantEffectCounts, VariantEffectAlleleFreq
x = ac.loadVariants("/Users/jpaschall/gnomad_mango_v1/run4/exome_chr22.adam")
VEAF = VariantEffectAlleleFreq(spark,x)
VEAF.plot()

VEC = VariantEffectCounts(spark, x)
VEC.plot()

Can we add unit tests to ensure correction?

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/629/
Test PASSed.

In addition to the "most deleterious" sort order and HIGH/MODERATE/LOW/MODIFIER mapping provided in the VCF ANN spec linked above, Ensembl VEP can output an additional field called Variant Class for Ensembl "display terms" and colors
http://useast.ensembl.org/info/genome/variation/data_description.html#classes
using the --variant_class command line argument.  I haven't used VEP with --vcf_info_field ANN very recently to know if ADAM picks up the VARIANT_CLASS field in TranscriptEffects correctly.
I starting working on VEP support in Cannoli this afternoon, so I should know soon if it works.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/659/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/661/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/mango-prb/662/
Test PASSed.

closed, replaced by #399


Adds force press gesture detector and recognizer

Adds for force touch support for force touch enabled devices through the creation of a force touch gesture recognizer. Fixes #4838.

To be clear, the range of pressures is:

0.0: not touching the screen (hover)
anything between 0 and 1: very light touch
1.0: touching the screen at a "normal" level (tap)
anything above 1.0: force pushing to various degrees
maxPressure: the maximum that the device can detect

If the OS has a different concept of "normal" then the data should be scaled to fit that range by the engine.
The meanings of values between 0 and 1 and above 1 are never going to be very consistent, even with the same hardware, user to user, since different hands have different strength muscles.
I think we could have the gesture recognizer normalize the range further, e.g. 0.0-1.0 for values less than 1.0 and 1.0-2.0 for values above 1.0, and base it on the normalized range (for most devices, the value will always be 1.0). It won't be perfect, but it's not clear to me what a developer would do that could be better even if we provide raw values to a predicate.

\o/


ship an automated approver for general usecases

Capturing thoughts from an email thread:
I think it would possible to leverage
the confidentiality of the service account token to do this e.g. an
approval controller will approve these dual client/server certs if and
only if:

the pod that is the subject of the CSR is running as the service
account that created the CSR.
the IPs in the SAN are a subset of the pod IP and service IPs of
the services the pod backs.
the hostnames in the SAN are a subset of the pod hostname and
service DNS names of the services the pod backs.
the pod isn't requesting to be in any RBAC groups.

@gcastle @liggitt @thockin

Can we just automate this further?  For every Service (probably opt-in, obv), create a TLS Secret.  Pods "in" that Service can use that Secret.
Rotate it.  Automatically.  No sidecar container, no further interaction from users.

I think the openshift service TLS controller works in the way you describe. Maybe we can just lift that in the short term. However while that model might make usage more convenient, all the keys to identity are stored in a central database which is suboptimal. This is already the case today with serviceaccount tokens but it's something we want to phase out. With a CSR model, the keys to the pod identity never travel over the network and never leave the container.

+1 to mike. If we had TLS certs backing service accounts as we've discussed internally we would avoid the central storage in secrets.
The model you describe, services provisioned TLS certs via secrets, is exactly what Istio does. If we're saying we need that in core kubernetes, we should consider breaking it out of istio.


IPV6 recognizer not working properly

I was trying to use presidio to identify and remove IP addresses, and I ran into the following issue. It was recognizing '::' as a string containing an IP address, and '2345:0425:2CA1:0000:0000:0567:5673:23b5' was not being recognized as an IP address. I ran a couple of tests as follows:
analyzer = AnalyzerEngine()

results = analyzer.analyze(text='::',
        entities=['IP_ADDRESS'],
        language='en')
print(results)

results2 = analyzer.analyze(text='2345:0425:2CA1:0000:0000:0567:5673:23b5',
        entities=['IP_ADDRESS'],
        language='en')
print(results2)

results3 = analyzer.analyze(text='2345:0425:2CA1::0567:5673:23b5',
        entities=['IP_ADDRESS'],
        language='en')
print(results3)

Output:
[type: IP_ADDRESS, start: 0, end: 2, score: 0.6]
[]
[type: IP_ADDRESS, start: 13, end: 30, score: 0.6]

This made it seem like it is just identifying an IPV6 address as any element that contains two consecutive colons. I then checked the source code, and found this in the tests:
https://github.com/microsoft/presidio/blob/4777d1759e9bddc45317d9b2689e6df9f75eec05/presidio-analyzer/tests/test_ip_recognizer.py#L24
Can the IPv6 regex be fixed?

Thanks for raising this. We'd be happy to review a PR if you're interested in contributing.

Seems like it was broken in https://github.com/microsoft/presidio/pull/312
Issued a PR to fix the regex, although still not optimal (see the tests scenario comments)
IMO should be transitioned to use the core module for a much simpler implemnetation:
https://docs.python.org/3/library/ipaddress.html?highlight=ipaddress#convenience-factory-functions
@omri374 Your thoughts?


C# SetPassphraseFunction cause access violation error

I am using latest ggpme-sharp with C# and VS2013,
my GPG version is 2.2.10.
I run the example PgpEncryptDecrypt, the pinentry dialog is prompted for passphrase and the decryption works.
then I set "pinentry-mode loopback" in gpg.conf, the MyPassphraseCallback is called, I passed the passphrase to it,
    public static PassphraseResult MyPassphraseCallback(
           Context ctx,
           PassphraseInfo info,
           ref char[] passwd)
    {
        passwd = Console.ReadLine().ToCharArray();

        return PassphraseResult.Success;
    }

now an unhandled is throws in gpgme-sharp\context.cs which says:
"An unhandled exception of type 'System.AccessViolationException' occurred in gpgme-sharp.dll
Additional information: Attempted to read or write protected memory. This is often an indication that other memory is corrupt."
the corresponding code is at line 621:
                int err = libgpgme.gpgme_op_decrypt(
                    CtxPtr,
                    cipher.dataPtr,
                    plain.dataPtr);

I think this maybe an issue in codes because if I decrypt using command line (gpg -d filename) and input password in the command line, the decryption also success.
Could you please help with it? thanks.

I'm hitting this as well. If I enable native debugging, I get this error message:

Exception thrown at 0x02D7E478 in dotnet.exe: 0xC0000005: Access violation executing location 0x02D7E478.

Unfortunately I can't find a prebuilt dev build of libgpgme-11.dll so I may need to compile it myself to be able to debug it.

Debugging this on the GnuPG mailing list: https://lists.gnupg.org/pipermail/gnupg-devel/2019-February/034190.html
I've made some changes so far, but it's still not working 100% properly: https://github.com/wget/gpgme-sharp/compare/master...Daniel15:pinentry. I'll submit a PR / land this once I get it working properly.

Fixed it... The callback was incorrectly using stdcall instead of cdecl calling convention, so it was corrupting the stack. Submitted PR #8 to fix it.

If you want to use the NuGet package, this should be fixed in 2.0.1: https://www.nuget.org/packages/gpgme-sharp/2.0.1

Hi, Im using 2.0.3 and the issue is the same. Raising AccessViolationException when generating the Key using the example-code from github:
https://github.com/gpgme-sharp/gpgme-sharp/blob/master/Examples/CreatePgpKey/Program.cs
GenkeyResult result = keygen.GenerateKey(Protocol.OpenPGP, aliceparam);
So it doesn't seem to have been fixed....


BUG: unable to render embed template (v1.1.0-rc2)

[11ty] (unknown path) [Line 1, Column 4]
[11ty]   unknown block tag: layout (via Template render error)
[11ty]
[11ty] Original error stack trace: Template render error: (unknown path) [Line 1, Column 4]
[11ty]   unknown block tag: layout
[11ty]     at Object._prettifyError (/Users/simon/Code/photogabble/website/node_modules/nunjucks/src/lib.js:32:11)
[11ty]     at Template.init (/Users/simon/Code/photogabble/website/node_modules/nunjucks/src/environment.js:416:19)
[11ty]     at Template.Obj (/Users/simon/Code/photogabble/website/node_modules/nunjucks/src/object.js:51:15)
[11ty]     at new Template (/Users/simon/Code/photogabble/website/node_modules/nunjucks/src/environment.js:390:18)
[11ty]     at Nunjucks.compile (/Users/simon/Code/photogabble/website/node_modules/@11ty/eleventy/src/Engines/Nunjucks.js:404:14)
[11ty]     at TemplateRender.getCompiledTemplate (/Users/simon/Code/photogabble/website/node_modules/@11ty/eleventy/src/TemplateRender.js:278:26)
[11ty]     at compile (/Users/simon/Code/photogabble/website/node_modules/@11ty/eleventy/src/Plugins/RenderPlugin.js:43:13)
[11ty]     at RenderManager.compile (/Users/simon/Code/photogabble/website/node_modules/@11ty/eleventy/src/Plugins/RenderPlugin.js:389:12)
[11ty]     at Interlinker.compileTemplate (/Users/simon/Code/photogabble/website/node_modules/@photogabble/eleventy-plugin-interlinker/src/interlinker.js:61:30)
[11ty]     at /Users/simon/Code/photogabble/website/node_modules/@photogabble/eleventy-plugin-interlinker/src/interlinker.js:153:37

Upon investigation the cause is trying to embed a file that doesn't exist. Due to my refactoring the plugin is attempting to embed the stub file into the page with the incorrect template language selected.
This is a regression, if a page can't be found, it can't be embedded.

Regression caused by splitting on # for <a id="..."/> linking

Ah-ha! Looks like Obsidian get around this by stopping you from having certain characters in page titles.


add key / indicator to record interface

I have to do several fixed-length conversions where I have a lot of differences per line in the file. Each line contains some kind of record type field the beginning of the line. The pzmap/record definitions are perfect to satisfy my requests so the conversion itself is ok for me.
I do however have some issues converting the result DefaultDataSet to xml. It would be very good for me that the record interface publishes the "row" or at least the mdkey of the row/record. Now when I loop thru the dataset, I have to go thru the metadata and getting all keys to see if it matches using the isRecordID method.
The attachment shows how I retrieve the record key using the getRecordKey methode.
I use flatpack in combination with apache camel.
show-dataset.js.txt

Hi
Thanks for contacting us. This is quite a coincidence as I'm currently on a project that deal with a lot of fixed width records as well.
As a matter of fact I have added a getRecordID method on the DataSet and Record interfaces.
A snapshot 4.0.2 is available on the snapshot repository.  Could you have a go with it and let me know if that is working for you?
Best regards
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) please note that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful. If you have received this communication in error please return it to the sender and
delete the original

On 6 Feb 2016, at 14:41, ronnyaerts<EMAIL_ADDRESS>wrote:
I have to do several fixed-length conversions where I have a lot of differences per line in the file Each line contains some kind of record type field the beginning of the line The pzmap/record definitions are perfect to satisfy my requests so the conversion itself is ok for me
I do however have some issues converting the result DefaultDataSet to xml It would be very good for me that the record interface publishes the "row" or at least the mdkey of the row/record Now when I loop thru the dataset, I have to go thru the metadata and getting all keys to see if it matches using the isRecordID method
The attachment shows how I retrieve the record key using the getRecordKey methode
I use flatpack in combination with apache camel
show-datasetjstxt
—
Reply to this email directly or view it on GitHub.

Where do I find the git link to the 4.0.2 snapshot.

It is the official repository
4.0.2 is not released yet but if you clone master you will have it
A jar file is available on the Sonatype snapshot maven repo. I'll send you the link later on as I'm out right now.
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) please note that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful. If you have received this communication in error please return it to the sender and
delete the original

On 6 Feb 2016, at 15:37, ronnyaerts<EMAIL_ADDRESS>wrote:
Where do I find the git link to the 4.0.2 snapshot.
—
Reply to this email directly or view it on GitHub.

I just did I clone and pull on https://github.com/Appendium/flatpack.git. The last comment on the master branch is "describe changes" on 29-jan-2016. None of the files contain a getRecordID.

Sorry about that it might still be internal.
I'll ensure that it is pushed tonight and drop you a note.
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) please note that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful. If you have received this communication in error please return it to the sender and
delete the original

On 6 Feb 2016, at 16:52, ronnyaerts<EMAIL_ADDRESS>wrote:
I just did I clone and pull on https://github.com/Appendium/flatpack.git. The last comment on the master branch is "describe changes" on 29-jan-2016. None of the files contain a getRecordID.
—
Reply to this email directly or view it on GitHub.

A snapshot is available at:
https://oss.sonatype.org/content/repositories/snapshots/net/sf/flatpack/flatpack-examples/4.0.2-SNAPSHOT/
Let me know
Thanks
Benoit
On 6 February 2016 at 17:10<EMAIL_ADDRESS>wrote:

Sorry about that it might still be internal.
I'll ensure that it is pushed tonight and drop you a note.
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s)
please note that any form of distribution, copying or use of this
communication or the
information in it is strictly prohibited and may be unlawful. If you have received
this communication in error please return it to the sender and
delete the original
On 6 Feb 2016, at 16:52, ronnyaerts<EMAIL_ADDRESS>wrote:
I just did I clone and pull on https://github.com/Appendium/flatpack.git.
The last comment on the master branch is "describe changes" on 29-jan-2016.
None of the files contain a getRecordID.
—
Reply to this email directly or view it on GitHub
https://github.com/Appendium/flatpack/issues/23#issuecomment-180809122.

--
Follow us on Twitter @appendium http://twitter.com/appendium and
http://www.appendium.com
IMPORTANT NOTICE This communication contains information that is considered
confidential and may also be privileged . It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s) please
note that any form of distribution, copying or use of this communication or
the information in it is strictly prohibited and may be unlawful. If you
have received this communication in error please return it to the sender
and delete the original.

I did a pull and the modifications look promising. I'll try to build it into apache camel on monday.

The changes work as expected.
Thank you for the change.

Excellent. Thanks for the feedback.

Hello Benoit,
Is it possible that the flatpack 4.0.2-SNAPSHOT is not available anymore in maven centralhttp://mvnrepository.com/artifact/net.sf.flatpack/flatpack?
--
Kind regards,
Ronny<EMAIL_ADDRESS>– Intris nv – Wapenstilstandlaan 47, 2600 Berchem, Belgium
R&D Integration Architect
Prince IIhttp://en.wikipedia.org/wiki/PRINCE2 certified – ITILhttp://en.wikipedia.org/wiki/Information_Technology_Infrastructure_Library certified
Tel: +32-3-326.50.75
From: Benoit Xhenseval<EMAIL_ADDRESS>Sent: zaterdag 6 februari 2016 20:17
To: Appendium/flatpack<EMAIL_ADDRESS>Cc: Ronny Aerts<EMAIL_ADDRESS>Subject: Re: [flatpack] add key / indicator to record interface (#23)
A snapshot is available at:
https://oss.sonatype.org/content/repositories/snapshots/net/sf/flatpack/flatpack-examples/4.0.2-SNAPSHOT/
Let me know
Thanks
Benoit
On 6 February 2016 at 17:10, <bx<EMAIL_ADDRESS>wrote:

Sorry about that it might still be internal.
I'll ensure that it is pushed tonight and drop you a note.
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s)
please note that any form of distribution, copying or use of this
communication or the
information in it is strictly prohibited and may be unlawful. If you have received
this communication in error please return it to the sender and
delete the original
On 6 Feb 2016, at 16:52, ronnyaerts <notifications<EMAIL_ADDRESS>wrote:
I just did I clone and pull on https://github.com/Appendium/flatpack.git.
The last comment on the master branch is "describe changes" on 29-jan-2016.
None of the files contain a getRecordID.
—
Reply to this email directly or view it on GitHub
https://github.com/Appendium/flatpack/issues/23#issuecomment-180809122.

--
Follow us on Twitter @appendium http://twitter.com/appendium and
http://www.appendium.com
IMPORTANT NOTICE This communication contains information that is considered
confidential and may also be privileged . It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s) please
note that any form of distribution, copying or use of this communication or
the information in it is strictly prohibited and may be unlawful. If you
have received this communication in error please return it to the sender
and delete the original.
—
Reply to this email directly or view it on GitHubhttps://github.com/Appendium/flatpack/issues/23#issuecomment-180841048.
Intris nv
Wapenstilstandlaan 47
B-2600 Berchem  Tel.  +32 3 326 50 75
Fax  +32 3 326 42 23
www.intris.behttp://www.intris.be/    [http://www.intris.be/mail/AEO_Sticker_108pxRGB.jpg] http://www.intris.be
DISCLAIMER
This is an e-mail from Intris. The information contained in this communication is intended solely for use by the individual or entity to whom it is addressed.
Use of this communication by others is prohibited. If the e-mail message was sent to you by mistake, please notify support<EMAIL_ADDRESS>destroy it without reading, using, copying or disclosing its contents to any other person.
We accept no liability for damage related to data and/or documents which are communicated by electronic mail.

Hi
It should be available on the snapshot repo from sonatype
Https://oss.sonatype.org/content/repositories/snapshots/net/sf/flatpack/
Let me know if it is ok
I'll probably do a release this month
Regards
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) please note that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful. If you have received this communication in error please return it to the sender and
delete the original

On 7 Mar 2016, at 10:24, ronnyaerts<EMAIL_ADDRESS>wrote:
Hello Benoit,
Is it possible that the flatpack 4.0.2-SNAPSHOT is not available anymore in maven centralhttp://mvnrepository.com/artifact/net.sf.flatpack/flatpack?
--
Kind regards,
Ronny<EMAIL_ADDRESS>– Intris nv – Wapenstilstandlaan 47, 2600 Berchem, Belgium
R&D Integration Architect
Prince IIhttp://en.wikipedia.org/wiki/PRINCE2 certified – ITILhttp://en.wikipedia.org/wiki/Information_Technology_Infrastructure_Library certified
Tel: +32-3-326.50.75
From: Benoit Xhenseval<EMAIL_ADDRESS>Sent: zaterdag 6 februari 2016 20:17
To: Appendium/flatpack<EMAIL_ADDRESS>Cc: Ronny Aerts<EMAIL_ADDRESS>Subject: Re: [flatpack] add key / indicator to record interface (#23)
A snapshot is available at:
https://oss.sonatype.org/content/repositories/snapshots/net/sf/flatpack/flatpack-examples/4.0.2-SNAPSHOT/
Let me know
Thanks
Benoit
On 6 February 2016 at 17:10, <bx<EMAIL_ADDRESS>wrote:

Sorry about that it might still be internal.
I'll ensure that it is pushed tonight and drop you a note.
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s)
please note that any form of distribution, copying or use of this
communication or the
information in it is strictly prohibited and may be unlawful. If you have received
this communication in error please return it to the sender and
delete the original
On 6 Feb 2016, at 16:52, ronnyaerts <notifications<EMAIL_ADDRESS>wrote:
I just did I clone and pull on https://github.com/Appendium/flatpack.git.
The last comment on the master branch is "describe changes" on 29-jan-2016.
None of the files contain a getRecordID.
—
Reply to this email directly or view it on GitHub
https://github.com/Appendium/flatpack/issues/23#issuecomment-180809122.

--
Follow us on Twitter @appendium http://twitter.com/appendium and
http://www.appendium.com
IMPORTANT NOTICE This communication contains information that is considered
confidential and may also be privileged . It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s) please
note that any form of distribution, copying or use of this communication or
the information in it is strictly prohibited and may be unlawful. If you
have received this communication in error please return it to the sender
and delete the original.
—
Reply to this email directly or view it on GitHubhttps://github.com/Appendium/flatpack/issues/23#issuecomment-180841048.
Intris nv
Wapenstilstandlaan 47
B-2600 Berchem Tel. +32 3 326 50 75
Fax +32 3 326 42 23
www.intris.behttp://www.intris.be/ [http://www.intris.be/mail/AEO_Sticker_108pxRGB.jpg] http://www.intris.be
DISCLAIMER
This is an e-mail from Intris. The information contained in this communication is intended solely for use by the individual or entity to whom it is addressed.
Use of this communication by others is prohibited. If the e-mail message was sent to you by mistake, please notify support<EMAIL_ADDRESS>destroy it without reading, using, copying or disclosing its contents to any other person.
We accept no liability for damage related to data and/or documents which are communicated by electronic mail.
—
Reply to this email directly or view it on GitHub.

Hello Benoit,
I added the sonatype repository to my maven settings and now I can retrieve the version.
--
Kind regards,
Ronny<EMAIL_ADDRESS>– Intris nv – Wapenstilstandlaan 47, 2600 Berchem, Belgium
R&D Integration Architect
Prince IIhttp://en.wikipedia.org/wiki/PRINCE2 certified – ITILhttp://en.wikipedia.org/wiki/Information_Technology_Infrastructure_Library certified
Tel: +32-3-326.50.75
From: Benoit Xhenseval<EMAIL_ADDRESS>Sent: maandag 7 maart 2016 11:43
To: Appendium/flatpack<EMAIL_ADDRESS>Cc: Ronny Aerts<EMAIL_ADDRESS>Subject: Re: [flatpack] add key / indicator to record interface (#23)
Hi
It should be available on the snapshot repo from sonatype
Https://oss.sonatype.org/content/repositories/snapshots/net/sf/flatpack/
Let me know if it is ok
I'll probably do a release this month
Regards
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) please note that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful. If you have received this communication in error please return it to the sender and
delete the original

On 7 Mar 2016, at 10:24, ronnyaerts <notifications<EMAIL_ADDRESS>wrote:
Hello Benoit,
Is it possible that the flatpack 4.0.2-SNAPSHOT is not available anymore in maven centralhttp://mvnrepository.com/artifact/net.sf.flatpack/flatpack?
--
Kind regards,
Ronny<EMAIL_ADDRESS>– Intris nv – Wapenstilstandlaan 47, 2600 Berchem, Belgium
R&D Integration Architect
Prince IIhttp://en.wikipedia.org/wiki/PRINCE2 certified – ITILhttp://en.wikipedia.org/wiki/Information_Technology_Infrastructure_Library certified
Tel: +32-3-326.50.75
From: Benoit Xhenseval<EMAIL_ADDRESS>Sent: zaterdag 6 februari 2016 20:17
To: Appendium/flatpack <flatpack<EMAIL_ADDRESS>Cc: Ronny Aerts <ronny.aerts<EMAIL_ADDRESS>Subject: Re: [flatpack] add key / indicator to record interface (#23)
A snapshot is available at:
https://oss.sonatype.org/content/repositories/snapshots/net/sf/flatpack/flatpack-examples/4.0.2-SNAPSHOT/
Let me know
Thanks
Benoit
On 6 February 2016 at 17:10, <bx@appendium.com<mailto:bx@appendium.commailto:bx<EMAIL_ADDRESS>wrote:

Sorry about that it might still be internal.
I'll ensure that it is pushed tonight and drop you a note.
Benoit

Important Notice
This communication contains information that is considered
confidential and may also be privileged. It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s)
please note that any form of distribution, copying or use of this
communication or the
information in it is strictly prohibited and may be unlawful. If you have received
this communication in error please return it to the sender and
delete the original
On 6 Feb 2016, at 16:52, ronnyaerts <notifications@github.com<mailto:notifications@github.commailto:notifications<EMAIL_ADDRESS>wrote:
I just did I clone and pull on https://github.com/Appendium/flatpack.git.
The last comment on the master branch is "describe changes" on 29-jan-2016.
None of the files contain a getRecordID.
—
Reply to this email directly or view it on GitHub
https://github.com/Appendium/flatpack/issues/23#issuecomment-180809122.

--
Follow us on Twitter @appendium http://twitter.com/appendium and
http://www.appendium.com
IMPORTANT NOTICE This communication contains information that is considered
confidential and may also be privileged . It is for the exclusive use of
the intended recipient(s). If you are not the intended recipient(s) please
note that any form of distribution, copying or use of this communication or
the information in it is strictly prohibited and may be unlawful. If you
have received this communication in error please return it to the sender
and delete the original.
—
Reply to this email directly or view it on GitHubhttps://github.com/Appendium/flatpack/issues/23#issuecomment-180841048.
Intris nv
Wapenstilstandlaan 47
B-2600 Berchem Tel. +32 3 326 50 75
Fax +32 3 326 42 23
www.intris.be<http://www.intris.be/http://www.intris.be<http:/www.intris.be/> [http://www.intris.be/mail/AEO_Sticker_108pxRGB.jpg] http://www.intris.be
DISCLAIMER
This is an e-mail from Intris. The information contained in this communication is intended solely for use by the individual or entity to whom it is addressed.
Use of this communication by others is prohibited. If the e-mail message was sent to you by mistake, please notify support@intris.be<mailto:support@intris.bemailto:support<EMAIL_ADDRESS>destroy it without reading, using, copying or disclosing its contents to any other person.
We accept no liability for damage related to data and/or documents which are communicated by electronic mail.
—
Reply to this email directly or view it on GitHub.

—
Reply to this email directly or view it on GitHubhttps://github.com/Appendium/flatpack/issues/23#issuecomment-193199998.
Intris nv
Wapenstilstandlaan 47
B-2600 Berchem  Tel.  +32 3 326 50 75
Fax  +32 3 326 42 23
www.intris.behttp://www.intris.be/    [http://www.intris.be/mail/AEO_Sticker_108pxRGB.jpg] http://www.intris.be
DISCLAIMER
This is an e-mail from Intris. The information contained in this communication is intended solely for use by the individual or entity to whom it is addressed.
Use of this communication by others is prohibited. If the e-mail message was sent to you by mistake, please notify support<EMAIL_ADDRESS>destroy it without reading, using, copying or disclosing its contents to any other person.
We accept no liability for damage related to data and/or documents which are communicated by electronic mail.


command line to launch task is badly formed for integrated terminal

VSCode Version: 1.10.0-insider
OS Version: Windows 10

Steps to Reproduce:

Create a launch config using "integratedTerminal"
Run it

My configuration creates the following command line, which isn't valid (pehaps there should be an && there instead of the semicolon?)
cd d:\Users\JAMIE\code\project; env NODE_ENV=mocha node --debug-brk=45564 --nolazy node_modules\mocha \bin\_mocha --watch --debug test/unit/**/*.ts
This is the config
        {
            "name": "Launch Unit Tests",
            "type": "node",
            "request": "launch",
            "program": "${workspaceRoot}/node_modules/mocha/bin/_mocha",
            "stopOnEntry": false,
            "args": [
                "--watch",
                "--debug",
                "test/unit/**/*.ts"
            ],
            "runtimeExecutable": null,
            "env": {
                "NODE_ENV": "mocha"
            },
            "sourceMaps": true,
            "console":"integratedTerminal",
            "outFiles": [
                "dist"
            ],
            "skipFiles": [
                "node_modules/**/*.js",
                "<node_internals>/**/*.js"
            ]
        }

@isidorn I assign back to you. It is a launch config without a pre task. Not sure so if this is debug or the integrated terminal.

As far as I understand, this is the integrated terminal can not handle some output the users program is computing. If I am mistaken then please provide more details @jamietre
Unrelated to debug. Assigning back to @Tyriar

This is a command generated by Visual Studio when I start my task called "Launch Unit Tests". It's not any code of mine or a user program. I assume it is produced entirely from the launch.json config I included above.
If I try to start this task using integratedTerminal, it fails, and it shows this command line in my integrated console:
cd d:\Users\JAMIE\code\project; env NODE_ENV=mocha node --debug-brk=45564 --nolazy node_modules\mocha \bin\_mocha --watch --debug test/unit/**/*.ts
If I start it using internalConsole then it works, and it only show this command line:
node --debug-brk=43169 --nolazy node_modules\mocha\bin\_mocha --watch --debug test/unit/**/*.ts
So using the integratedTerminal option seems to generate an extra cd command (even though the terminal already seems to open in the working directory) and separates it from the debug launch command with a semicolon.

@isidorn @weinand I think it's related to debug launching the user configured shell, not a specific one so the command appending being used is not reliable. You can also set the cwd in IShellLaunchConfig when creating an ITerminalInstance now which is the best fix for this.

Assigning to @weinand since TerminalSupport is handling this I believe

I haven't tried this in a few days, but In today's preview, using "intergratedTerminal" or "externalTerminal", it's broken in a different way:

Seems like it's not quoting the CLI exe path itself properly now...
"terminal.integrated.shell.windows": "c:\\program files\\JPSoft\\TCCLE14x64\\tcc.exe",

Opening a terminal window works fine still, but launching a task with it doesn't at all any more. "internalConsole" is the only one working.

Verification notes:
The fix addresses issues that occurred when configuring the console attribute in launch configs to integratedTerminal and configuring a shell for the integrated terminal via the terminal.integrated.shell.*settings:

if the configured shell is not recognised the code no longer falls back to assume a unix shell but uses the platform default, on Windows: cmd.exe on linux & macOS: bash.
if a bash shell is configured on Windows (e.g. git bash.exe or WSL bash.exe), it is properly recognised.

Verified the first item


feat: add account form component

closes #22

@matt-user this PR has broken build which makes harder to quick testing
we normally review only really ready for review PRs, by that means all green
if build is broken in CI , normally you can reproduce locally with pnpm build:all


[Bug]: Users blocked via website show as avoided in chobby

Describe the Bug
Users blocked via website show as avoided in chobby.
Reproduce the bug

Join multiplayer
Find a random lobby
Copy someone's name
Go to teiserver and search that user then block them
Restart chobby.
Find that user again in chobby. Hover over them. It will say they are avoided but it should say they are blocked.
Now go back to teiserver and ignore them
Restart chobby and find that user. Chobby will show them as ignored (rather than avoided or blocked)

Screenshots
No response
Additional context
No response

This might be chobby bug


Change Order of Server Groups

It is not currently possible to drag-rearrange server groups. To change the order of custom server groups, the user must delete and remake the groups in the desired sequence. It is possible to drag and drop server groups inside one another, but not to drag them above and below to change their order.
Change the UI to allow the order to be altered by moving server groups above and below.
Create a button that opens the settings in a text file for modification

As a workaround you can also modify the settings file directly.

Run the Preferences: Open Settings (JSON) command
Find the datasource.connectionGroups section
Re-order the groups there as desired
Close and re-open ADS

The groups should now be in the new order.

That worked. Thanks @Charles-Gagnon

Closing as duplicate of https://github.com/microsoft/azuredatastudio/issues/167


Container won't restart --replication + ldaps ---read_config: no serverID / URL match found. Check slapd -h arguments.

Hello,
I previously opened a case about replication + LDAP_TLS_ENFORCE:true.  This case is about replication + ldaps (636) only.
Again, we have deployed 2 openldap containers with host replication.  We need pass traffic on port 636 only and use ldaps for the host replication.
Each container are on their own RHEL7 linux server with docker engine installed and no clusters. We have mounted 2 docker volumes for /var/lib/ldap and  /etc/ldap/slapd.d.  We have created our custom image based on "extend-osixia-openldap" .  In attachment you will find:

a Dockerfile,
a startup script
a startup file
2 log files for openldap. 1.txt (start successful) and 2.txt (restart and crash)

Here's the scenario
ldap1 and ldap2 are not created yet
On ldap 1:
start the container

create 2 new volumes
start container, populate docker volumes
Everything is up running, no issues. (see 1.txt)

When I restart the openldap container,

use existing docker volumes

Container won"t start (see 2.txt)
5c65be5d send_ldap_result: err=0 matched="" text=""
=> ldap_bv2dn(cn=Subschema,0)
<= ldap_bv2dn(cn=Subschema)=0
=> ldap_dn2bv(272)
<= ldap_dn2bv(cn=subschema)=0
5c65be5d read_config: no serverID / URL match found. Check slapd -h arguments.
5c65be5d slapd stopped.
5c65be5d connections_destroy: nothing to destroy.
On ldap 2:
same behavior
Take a look at daemon_init:
When successfull (1.txt)
5c65be18 @(#) $OpenLDAP: slapd  (Dec 30 2018 18:24:00) $
Debian OpenLDAP Maintainers<EMAIL_ADDRESS>5c65be18 daemon_init: ldap://openldap1.dev-18.loto-quebec.org ldaps://openldap1.dev-18.loto-quebec.org ldapi:///
When it crashed (2.txt)
5c65be5d @(#) $OpenLDAP: slapd  (Dec 30 2018 18:24:00) $
Debian OpenLDAP Maintainers<EMAIL_ADDRESS>5c65be5d daemon_init: ldap://openldap1.dev-18.loto-quebec.org  ldap://localhost ldapi:///
5c65be5d daemon: bind(7) failed errno=99 (Cannot assign requested address)
5c65be5d daemon: bind(8) failed errno=99 (Cannot assign requested address)
ldaps-replication-hosts-issues-on-restart.zip

this case is for osixia/openldap


Usage Tiers

This pull request adds (and hopefully clarifies) the API usage tiers that have been discussed many times in Discord, but never formalized.
Highlights:

There is, and will remain a free tier.  Woo!
We're permanently expanding the free tier, by adding a "community tier".  For an increased rate limit, you agree to share data about how you're using the data.  This isn't shared with any other API users, and we use it to see how players are using various sites and tools.  Initially this will only affect website by requiring that you include gamelocker.js on your site.  This will inject a google analytics tag.
We're continuing to be a bit vague on the "commercial tier" but after chatting with several dozen large products, we have a clear idea of what they need.  These licenses are really focused at companies that have revenue or venture backing.  Because they are paid licenses, there will be no data sharing requirement.

UNRELATED: gamelocker.js will also add oembed support, allowing your site to convert telemetry files into visible graphs, etc.

Lots of open questions about the community tier including what is data? How will the data be fed on different platforms, etc.

Commercial users also get bulk access, increased webhook limits, statistical samples, and more.
Does this mean samples endpoint is only open to commercial users?

That's a good question. It seems most of the requests for the data samples feature come from starting hobbiest tier devs who do not have the means of creating a large collection of matches that they could themselves use to gather their own samples. But "statistical samples" may be something else.

I'm going to leave this as "TBD" for samples.  I think it will still be a community feature, but I don't want to commit right now until we chat with more commercial folks.


The BitDataGrid component is not responsive enough and will be rendered incorrectly in small screens

I think this issue already exists(#2787). @msangtarash @msynk ??

@sajadkardel you are right.
but the image provided in issue #2787 is not a good one. could you plz update the image and use a better one? like the one in this issue.
I'm closing this issue since it's a duplicate of #2787


power tool setting not opening from taskbar

Microsoft PowerToys version
0.62.1
Running as admin

[X] Yes

Area(s) with issue?
General
Steps to reproduce
power tool not opening from task bar and opening multiple tabs at background
✔ Expected Behavior
No response
❌ Actual Behavior
No response
Other Software
No response

Not able to repro this, going to close. Let us know if you see this again!


Remove actions versioning strategy

Versioning strategies are not supported for actions.
From https://github.com/staabm/phpstan-dba/pull/614#issuecomment-1657066369

Works now, thx

You're welcome.