integ-tests: implement support to select integration tests to run with a YAML config file

Please take a look at the README file included in this PR in order to understand what are the new features introduced by this change.
Below I reported a more detailed explanation of the reasons that drove this change.

Integration Testing Framework - Tests Config
How do we currently configure integration tests?
tl;dr; Tests when defined are decorated with some annotations that declare dimensions they are allowed to run against. Later at test submission time a list of dimensions to test (regions, instances, oss, schedulers) needs to be passed to the cli. The end result is that an intersection of the input and the declared dimensions is what determine what tests are ran.
https://github.com/aws/aws-parallelcluster/blob/develop/tests/integration-tests/README.md#specify-tests-dimensions
What are the current limitations?
With the current approach, when integration tests are defined they are decorated with some annotations that specify the dimensions (regions, instances, schedulers, oses) they are allowed to run against. Later at test submission time, for each dimension, a list of values is provided in order to globally define the allowed dimensions for the specific test run. The end result is that an intersection of the input dimensions and the test function whitelisted dimensions is what determine what tests are executed.
This approach was reasonable when having a reduced amount of tests and most of all when we didn’t need to run different tests suites for various types of validations. Currently we are facing the following limitations:

It is hard to understand what tests are going to be executed given a set of input dimensions. A dryrun option makes it possible to obtain that list but this results in a tedious and error prone process especially when establishing the dimensions you want to run a test against
With a growing number of tests it is hard to selectively choose the dimensions for each test and at the same time distribute the number of clusters we create across all AWS regions. When tests are not uniformly distributed the overall runtime is going to be affected by the slowest region.
It is not possible to dynamically change the tests to execute without performing a code change. This is very useful now that we want to maintain different test configs to run against different versions, branches or features.
In case of an issue it is hard to simply run a single or a subset of tests against specific dimensions.
It is hard to have a clear overview of the existing tests and the related dimensions they are tested against. This makes it harder to design new tests or rebalance existing ones in order to reduce the overall runtime

Solution
Have a configuration file that defines the test suites to execute and the dimensions for each test. The configuration file supports jinja2 templating engine in order to enable additional features such picking random dimensions and uniformly distribute tests cross regions.

The following file is not required but an example of how to use jinja2 to collect common variables in a single common place

{%- set REGIONS_COMMERCIAL = ["us-east-1", "eu-west-1", "..."] -%}
{%- set OSS_COMMERCIAL = ["alinux", "centos7", "..."] -%}
{%- set INSTANCES_COMMERCIAL = ["c5.xlarge", "..."] -%}
{%- set INSTANCES_EFA = ["c5n.18xlarge", "p3dn.24xlarge", "i3en.24xlarge"] -%}
{%- set SCHEDULERS_ALL = ["slurm", "sge", "torque", "awsbatch"] -%}
{%- set SCHEDULERS_TRAD = ["slurm", "sge", "torque"] -%}

The following config declares the tests suites to run and ideally we are going to have one definition per partition in our code base. Additionally when developing you can have your config file to run specific tests.

{%- import 'common.jinja2' as common -%}
---
test-suites:
  cfn-init:
    test_cfn_init.py::test_replace_compute_on_failure:
      dimensions:
        - regions:
            - {{ common.REGIONS_COMMERCIAL|random }}
          instances:
            - {{ common.INSTANCES_COMMERCIAL|random }}
          oss: {{ common.OSS_COMMERCIAL }}
          schedulers:
            - {{ common.SCHEDULERS_TRAD|random }}
        - regions:
            - us-east-1
          instances:
            - c5n.16xlarge
          oss:
            - centos7
          schedulers:
            - sge
  efa:
    test_efa.py::test_efa:
      dimensions:
        - regions:
            - {{ common.REGIONS_COMMERCIAL|random }}
          instances: {{ common.INSTANCES_EFA }}
          oss:
            - alinux
            - centos7
            - ubuntu1604
          schedulers:
            - sge
            - slurm
  scaling:
    test_scaling.py::test_multiple_jobs_submission:
      dimensions:
        - regions: {{ common.REGIONS_COMMERCIAL }}
          instances: {{ common.INSTANCES_COMMERCIAL }}
          oss: {{ common.OSS_COMMERCIAL }}
          schedulers: {{ common.SCHEDULERS_TRAD }}

Tests are submitted with the following command:

python -m test_runner \
    --key-name "ec2-key-name" \
    --key-path "~/.ssh/ec2-key.pem" \
    --tests-config "path/to/config"

The features flag can still be used to select specific test suites from a broader config file although you can have your config file when developing.

Tests configs for our recurrent tests run can be committed inside our code base. For example we can have 3 configs for develop tests (develop-china.conf, develop-commercial.conf, develop-govcloud.conf) and 3 configs for tests against the latest released version (prod-china.conf, prod-commercial.conf, prod-govcloud.conf). Jenkins will select the appropriate config in its daily test runs. Moreover jenkins can accept a custom config files to allow ad hoc test runs (at the beginning this can be provided in a text field and in the future we can also allow s3 urls).

FAQ
Why YAML?
Because we can add comments to the config file and it’s more compact than json
Why dimensions is an array of objects?
Because for every object in the array, tests are executed for all combinations of the given dimensions. For example let’s suppose you want to run a given tests for all schedulers but only a subset for awsbatch. You can do it with something like:
{%- import 'common.jinja2' as common -%}
---
test-suites:
  my-test:
    test_something.py::test_something_works:
      dimensions:
        - regions: {{ common.REGIONS_COMMERCIAL }}
          instances: {{ common.INSTANCES_COMMERCIAL }}
          oss: {{ common.OSS_COMMERCIAL }}
          schedulers: {{ common.SCHEDULERS_TRAD }}
        - regions:
            - us-east-1
          instances:
            - t2.micro
          oss:
            - centos7
          schedulers:
            - awsbatch

How can this be extended to support AZs specification?
The idea is to allow to specifies AZs together with the regions as shown below:
{%- import 'common.jinja2' as common -%}
---
test-suites:
  my-test:
    test_something.py::test_something_works:
      dimensions:
        - regions:
            - us-east-1
              - use1-az6
              - use1-az2
            - eu-west-1
          instances: {{ common.INSTANCES_COMMERCIAL }}
          oss: {{ common.OSS_COMMERCIAL }}
          schedulers: {{ common.SCHEDULERS_TRAD }}

when not specified a random AZ is picked.
when multiple AZs are specified tests will run in multiple AZs

Why using a template engine for the configurations?

To reduce the size of the config file
To have a single place where to define shared dimensions
To have the possibilities to apply functions such as random selection in arrays

Why randomly selecting a region?

To better distribute tests across regions and reduce overall execution time
Over time we increase coverage for features that are tested in a single region per partition

The downside is that test metrics can be affected

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

I'm going to open a new PR since I can make Travis run on this one


Remove bad link in red tile (EN) blog

This PR resolves issue  https://github.com/corona-warn-app/cwa-website/issues/2976  "Link failure in red tile blog (EN)".
It removes the failing link to https://www.zusammengegencorona.de/en/ansteckung-mit-corona-so-wird-das-coronavirus-uebertragen/ in the blog article https://www.coronawarn.app/en/blog/2021-12-15-cwa-red-tile-guidance/ "What should you do if you see a red tile?".

This paragraph in the English language blog is then equivalent to the German language blog, which already had no link.

@MikeMcC399 Thanks, see https://github.com/corona-warn-app/cwa-website/issues/2976#issuecomment-1161733511


Use pycon lexer to highlight code Python console code blocks

The lexer is documented at:
https://pygments.org/docs/lexers/#pygments.lexers.python.PythonConsoleLexer
It is the preferred lexer for the Python console and its output.
Pull Request check-list
Please make sure to review and check all of these items:

[x] Does $ tox pass with this change (including linting)?
[x] Does travis tests pass with this change (enable it first in your forked repo and wait for the travis build to finish)?
[ ] Is the new or changed code fully tested?
[x] Is a documentation update included (if this change modifies existing APIs, or introduces new ones)?

NOTE: these things are not required to open a PR and can be done
afterwards / while the PR is open.
Description of change
Please provide a description of the change here.

Codecov Report

Merging #1327 into master will decrease coverage by 2.39%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1327      +/-   ##
==========================================
- Coverage   92.85%   90.45%   -2.40%
==========================================
  Files          19       19
  Lines        6534     6369     -165
==========================================
- Hits         6067     5761     -306
- Misses        467      608     +141

Impacted Files
Coverage Δ

redis/_compat.py
64.51% <0.00%> (-22.69%)
:arrow_down:

redis/utils.py
53.33% <0.00%> (-15.42%)
:arrow_down:

redis/connection.py
67.60% <0.00%> (-14.62%)
:arrow_down:

tests/test_multiprocessing.py
77.89% <0.00%> (-0.90%)
:arrow_down:

tests/conftest.py
96.62% <0.00%> (-0.25%)
:arrow_down:

redis/client.py
86.14% <0.00%> (-0.13%)
:arrow_down:

tests/test_encoding.py
97.53% <0.00%> (-0.09%)
:arrow_down:

tests/test_connection_pool.py
97.77% <0.00%> (-0.07%)
:arrow_down:

tests/test_pubsub.py
99.14% <0.00%> (-0.02%)
:arrow_down:

tests/test_sentinel.py
99.13% <0.00%> (-0.02%)
:arrow_down:

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3261a05...6d4a333. Read the comment docs.

Great, thanks.


Non-textured face make the mnodel loader crash

For instance, in an .obj file, the following statement makes the model loader crash:
f a//b …

**Possible fix: just replace None values by -1 and treat that as (0., 0.) for UV mapping.


use method name as topic name

NetflixOSS » suro » suro-pull-requests #37 ABORTED

NetflixOSS » suro » suro-pull-requests #38 SUCCESS
This pull request looks good

suro-pull-requests #207 FAILURE
Looks like there's a problem with this pull request

suro-pull-requests #208 FAILURE
Looks like there's a problem with this pull request


ASP.NET Core support for WCF pass through Windows Authentication

I have a .NET Core class library which consumes the Microsoft MDS (Master Data Services) WCF service and authenticates via a explicitly specified username/pass with basicHttpBinding over SSL. I also have a ASP.NET Core Web API project which consumes this class library and exposes the data returned as JSON data back to the client. This all works fine.
I'm currently hard coding the user/pass in the WCF client class library and would like to instead use Windows Authentication through IIS to pass through the authenticated user to the WCF service.
I've setup IIS for Windows Auth, and the ASP.NET solution / Web.config for Windows authentication according to the documentation.
startup.cs ConfigureServices override:
services.Configure<IISOptions>(options => {
                //options.AuthenticationDescriptions holds a list of allowed authentication schemes
                options.AutomaticAuthentication = true;
                options.ForwardClientCertificate = true;
            });

Web.config:
<aspNetCore processPath="%LAUNCHER_PATH%" arguments="%LAUNCHER_ARGS%" stdoutLogEnabled="false" stdoutLogFile=".\logs\stdout" forwardWindowsAuthToken="true" />
I'm attempting to authenticate against the WCF service using the following statement:
service.ClientCredentials.Windows.ClientCredential = System.Net.CredentialCache.DefaultNetworkCredentials;
The problem is no matter what combination of settings I try it always returns access denied. It works fine if I manually plug in the same user's user/pass manually. I can output User.Identity correctly in my controller and I've even tried wrapping the entire WCF login in RunImpersonated call:
var winIdent = user.Identity as WindowsIdentity;
WindowsIdentity.RunImpersonated(winIdent.AccessToken, () => _mdsClient.Login(loginRequest));

The same behavior is experienced using .NET Core 1.1.2 and 2.0 release versions. Is this scenario not supported? How do I pass through the logged in user?

This should help: https://github.com/dotnet/corefx/issues/9996

Thinks @Tratcher but this scenario is a little different, I'm not trying to pass through a trusted SQL connection, but a to a WCF login, which is a little different. I tried every tip in that thread already except running on full stack .NET.

This issue is being closed because it has not been updated in 3 months.
We apologize if this causes any inconvenience. We ask that if you are still encountering this issue, please log a new issue with updated information and we will investigate.


Allow revisions of 2 or more digits for yocto-based-OS-image

Change-type: patch
Signed-off-by: Kyle Harding<EMAIL_ADDRESS>

@balena-ci I self-certify!


Always escape asterisks

I see the problem from last time... it only worked if wrappers were being used, which obviously isn't always the case.


Change patient UUID to identifier

No ticket for this, this is a bug fix

@praveenadayanand rebase done!


Muliple GWT compilation problems :

MaxPermSize and Java 8
Page's role
GWT module name

New dependencies :

gwt-material 1.5.3
gwt-material-themes 1.5.2
gwt-material-addins 1.5.2

I had a look on this change. I wonder why the project has WEB-INF/classes and binary class files. Now some modifications showed up in this area...
Looks like this is something missing in .gitignore . Probably the next change could clean up it and fix ignores.

Thanks for all your changes :)


Unknown StepType for input type fields

Observe that getting error as unknown StepType for Input fields when I tried to record journey using Recorder,
I tried for standard demo app Browse Order app https://sapui5.hana.ondemand.com/test-resources/sap/m/demokit/orderbrowser/webapp/test/mockServer.html?sap-ui-theme=sap_horizon#
Tried to Search field to input some text but unfortunately not recorded correctly by Recorder, is that version issue?
As I checked couple of videos in that it seems for input enterText("") correctly recorded but for me it didn't worked,
Reference video https://youtu.be/oJCcFkwYyYM?t=675
Is there I missed something? @tabris87

So currently i don't see an issue within your usage.
As the generated code looks not clean as well.
I will check with the provided app.

@prashant4be: I fixed the intended behaviour of the JourneyRecorder.  The Click/Validation Step followed by consecutive KeyPress Steps should be converted into one InputStep.
This also leads to the correct test code

Thank you for the update.


Wrist Mk2.1 info integration

Adding some info regarding our latest designed wrist, also moving some bits from the hand section to the wrist.

Thanks heaps @Lawproto for the updates!
The last point to address is:

We also need to fix/update the following in the main navigation section:
https://github.com/Lawproto/documentation/blob/wrist_patch/mkdocs.yml#L169-L170

Thanks heaps @Lawproto for the updates!
The last point to address is:

We also need to fix/update the following in the main navigation section:
https://github.com/Lawproto/documentation/blob/wrist_patch/mkdocs.yml#L169-L170

@pattacini done.


Remove contact form page

See #208 for the initial bug report.
Tasks

Make the contact form work

Background

A few different CSRF issues were reported the last week of April
Most were fixed in https://github.com/cppalliance/boost.org/pull/240
I checked the contact form today and it still gives a CSRF error:

Per meeting today, we aren't using this page


Using Compiled Bindings to Properties of a Record Type Doesn't Fail Until Runtime

Describe the bug
If I use a compiled binding to a property of a record type, the compilation succeeds, only to get an InvalidProgramException at runtime when Avalonia attempts to set the property value.
To Reproduce
public record TestRecord(string Prop);

public class TestViewModel : ViewModelBase
{
    private TestRecord _testObj = new("");
    public TestRecord TestObj
    {
        get => _testObj;
        set = this.RaiseAndSetIfChanged(ref _testObj, value, nameof(TestObj));
    }
}

...
    <TextBox Text="{CompiledBinding TestObj.Pro}" />
...

Expected behavior
This would refuse to compile.
Actual behavior
It compiles, and Avalonia generates this IL at CompiledAvaloniaXaml.XamlIlHelpers.{path}.Name!Setter(object, object):
  .method compilercontrolled static void
    '{path}.Name!Setter'(
      [in] object obj0,
      [in] object obj1
    ) cil managed
  {
    .maxstack 2

    IL_0000: ldarg.0      // obj0
    IL_0001: castclass    {object type}
    IL_0006: ldarg        obj1
    IL_000a: castclass    [System.Runtime]System.String
    IL_000f: callvirt     instance void modreq ([System.Runtime]System.Runtime.CompilerServices.IsExternalInit) {path}::set_Name(string)
    IL_0014: pop
    IL_0015: ret

  } // end of method XamlIlHelpers::'{path}.Name!Setter'

After the first two opcodes, there's an object on the stack. The next two push a string onto the stack. Then the callvirt pops those two, leaving the stack empty. Then Avalonia threw in a random pop that would make a stack underflow before returning. Because of that random pop opcode, the runtime refuses to run that function and dotPeek refuses to decompile it.
Screenshots

Desktop

OS: Windows 11 and Raspbian Buster (not that it matters)
Version 0.10.15

Additional context
Roslyn apparently generates public setters for record types, which Avalonia was able to bind to. Hence, why the compilation succeeded.

Changing the record type to a class type with public getters and setters (obviously) fixes the exception.

It might require changes in XamlX repo, if anybody wants to pick it up
https://github.com/kekekeks/XamlX

The emission of the pop opcode is indeed happening inside XamlX:
https://github.com/kekekeks/XamlX/blob/d990d63774a04d2a4b3d52e626a90ee68e19e2b6/src/XamlX/IL/XamlILEmitterExtensions.cs#L23-L24
if (swallowResult && !(method.ReturnType.Namespace == "System" && method.ReturnType.Name == "Void"))
    emitter.Pop();

The problem appears for init properties (which records use).
Minimal repro:
public class TestClass { public string Prop { get; init; } }

<TestClass Prop="foo" />

It currently works with System.Reflection.Emit (loading xaml files at runtime) but not Cecil (build time).
Making it work for Cecil seems easy enough: ReturnType.Name is modreq(IsExternalInit) void instead of void in this case, taking the underlying type if there's a modreq/modopt should be enough. I can open a PR for that.
But if this runs, init setters then can be set several times, and they probably shouldn't. IMO, an ideal solution would be to disallow two-way bindings (both compiled and reflection ones) to init properties, and only allow them in XAML setters when an object is being created, to mimic C# behavior. That can be considered a new feature though.

Ah, that would explain why there's a setter. You're right about them being modifiable; a record is supposed to be immutable. For me, I don't think preventing binding to init only properties would be a feature, but a bugfix. Sure, it's a PEBKAC, but it's still a bug IMO.

I've opened a PR to at least fix the InvalidProgramException, so compiled bindings don't crash and work the same way as reflection bindings do currently.
Blocking init two-way/one-way-to-source bindings is another task, and if done, should be done both for compiled and reflection bindings. It depends on what the project maintainers think about it.

I see the PR in XamlX has been merged. Should we close this now?

You can double check in latest master and if it's fixed there, it's good to close I guess.

Note that merging something to XamlX doesn't automatically include the new version into Avalonia

Hence why I asked. It seems Avalonia's master is on a4e6be2d dated June 30th. I'll leave it open until the submodule commit reference is updated, I guess.

This appears to have been fixed in 9acb2a11 (the 11.0-preview1 tag), so I'm gonna mark this closed now.


#2988 added timeout to helm install

Closes #2988
Added a timeout of 10minutes to the helm upgrade command - QQ: would it make sense to make this configurable as a parameter to the install command?
In case of a timeout, added a hint to check the status of the installation via kubectl get pods -n <keptn-namespace>. In issue #2988 it was suggested to specifically check for an ImagePullBackOff in the deployments, but given that a timeout might have numerous reasons, I was thinking a more general hint might be better suited in this case.
Signed-off-by: Florian Bacher<EMAIL_ADDRESS>

Added a timeout of 10minutes to the helm upgrade command - QQ: would it make sense to make this configurable as a parameter to the install command?
IMO we could make it configurable, but I don't see the need of it right now.

In case of a timeout, added a hint to check the status of the installation via kubectl get pods -n . In issue #2988 it was suggested to specifically check for an ImagePullBackOff in the deployments, but given that a timeout might have numerous reasons, I was thinking a more general hint might be better suited in this case.

Sounds good.

Added a timeout of 10minutes to the helm upgrade command - QQ: would it make sense to make this configurable as a parameter to the install command?
IMO we could make it configurable, but I don't see the need of it right now.

In case of a timeout, added a hint to check the status of the installation via kubectl get pods -n . In issue #2988 it was suggested to specifically check for an ImagePullBackOff in the deployments, but given that a timeout might have numerous reasons, I was thinking a more general hint might be better suited in this case.

Sounds good.


Added DocBlock information for properties

DocBlock information from conversation here.

Thanks for working on this @dfelton!
Could you instead do the docblocks on the methods like we did in the http-server library for the Options object there? Having that documentation on the methods makes it easier to find that information because it shows up in PhpStorm when using the accessor and modifier methods.

Certainly @trowski! I looked for inspiration within amp/websocket but examples were somewhat lacking :) No worries though that's why I'm offering the help.
I'm at work now, but expect an update to this PR this evening or later this week.

Sorry fumbling with some things caused this PR to close. Then a force-push to my branch disallows me to re-open the PR  ¯\_(ツ)_/¯. Will have to submit as a new one.


Add data path controls to Local Server samples

Description
Adds controls to the UI of Local Server samples allowing for control over AppDataPath used. The brunt of changes are because this requires restarting the app. This necessitates restructuring how the Local Server samples operate at a foundational level in some cases.
Type of change

Sample viewer enhancement

Platforms tested on

[x] WPF .NET 6
[ ] WPF Framework
[x] WinUI

Checklist

[x] Self-review of changes
[x] All changes work as expected on all affected platforms
[x] There are no warnings related to changes
[x] Code is commented and follows .NET conventions and standards
[ ] Codemaid and XAML styler extensions have been run on every changed file
[ ] No unrelated changes have been made to any other code or project files
[ ] Screenshots are correct size and display in description tab (800 x 600 on Windows, MAUI mobile platforms use the MAUI Windows screenshot)

Closing this issue for now.


While overlay is shown, still able to zoom other images in viewport. Strange behavior follows.

If there are multiple images with the zoom ability applied within the viewport, they can continue to be clicked and zoomed while the overlay is open for another image already if they happened to be below the overlay but not beneath the zoomed image (i.e. the white overlay doesn't prevent clicks from being registered with images below).
If this happens, the previous zoomed image does somewhat return to it's position, but it does not scale back down properly, and if you click it again the scale is compounded.
Successfully duplicated the problem in Safari 8.0.3, Chrome 42.0.2311.135, and Firefox 37.0.2.

@fat @alexjacque Hi guys, pushed a fix for this little issue. :+1:

should be fixed, thanks


Make some of the Java classes proper utilities

Purpose
Closes ballerina-platform/ballerina-standard-library#4926.
Examples
Checklist

[x] Linked to an issue
[ ] Updated the specification
[x] Updated the changelog
[ ] Added tests
[ ] Checked native-image compatibility

@MohamedSabthar I rebased this branch - could you please approve the workflows again?

@MohamedSabthar I made another rebase. Please approve the workflows again.


[Bug] - Dropdown - rerenders focuses dropdown randomly

https://stackblitz.com/edit/stackblitz-starters-rbhayr?file=package-lock.json

@Powerplex , we can close this one, right?


The LND service is running with error v.1.2

After new SDK/HDD/Power.plug/Raspberry/Blockchain download and sync. - wallet recover
But still LND not working
           RaspiBlitz v1.2  21btc.club
           bitcoin Fullnode + Lightning Network
    ,/     -------------------------------------------
  ,'/      CPU load 0.75, 0.82, 0.73, temp 50°C 82°F
,' /       Free Mem 605M / 927M  Free HDD 613G (66%)

,'  /_____,  ssh<EMAIL_ADDRESS>▼27.8MiB ▲11.6MiB
.'____    ,'
/  ,'    bitcoin v0.17.1 mainnet Sync OK 100.00%
/ ,'      DynDNS 21btc.club.master-node.cc 8 connections
/,'
/'          LND   Not Started | Not Ready Yet
When I try unlock wallet manually
admin@21btc:~ $ lncli unlock
Input wallet password:
[lncli] rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp <IP_ADDRESS>:10009: connect: connection refused"
After reboot is the same problem
First comes
9 times

then

The LND service is running with error.

If you just started some config/setup, this might be OK.
4 RESTARTS DETECTED - LND might be in a error loop
-> Use following command to debug: /home/admin/XXdebugLogs.sh
-> To force Main Menu run: /home/admin/00mainMenu.sh
-> To try restart: sudo shutdown -r now
(exit after too much restarts/unlocks - restart to try again)
debug here
https://termbin.com/ulve1

The cat/tail errros are not a critcal problem - just a debug output that you can ignore.
Reading your debug - your LND has the following problem and shutsdown:
2019-05-13 13:51:20.976 [ERR] SRVR: unable to create server: unable to read bucket for chain=f0b74181eeff906b6c254d475c7d5ff85793e29bd757f4eee96eb41148fa338c00000001
Havent seen that before, might be a data corruption if its not able "to read" stuff - best would to check hardware if power supply needs improvement for the future and research on LND GitHub if there is a fix for this error.

Hardware test is ok. i restorer on a running empty wallet like discreet from here.
https://github.com/rootzoll/raspiblitz/blob/master/FAQ.md#i-dont-have-a-lan-port-on-my-laptop---how-to-connect-to-my-raspiblitz
but after restorer my old back up I got the same error
LND service is running with error.
my debug log file
https://termbin.com/5ybc

@btc21cluib did you find any detail on that error message on the LND GitHub? Or any repsonse on it from the LND Slack? https://dev.lightning.community ... if they say its due to "data corruption", please ask how to repair the LND data then.

@rootzoll I open a new issues here at LND-still waiting for a solution
https://github.com/lightningnetwork/lnd/issues/3079#issuecomment-492793232

@rootzoll I open a new issues here at LND-still waiting for a solution
lightningnetwork/lnd#3079 (comment)

I think the solution is to re-download and re-sync the blockchain.  I think the corruption is with the blockchain DB not LND.

@fluidvoice  Thanks for your response.
I was thinking the same before also, but after two times download form other HDD and one time via torrent download, I got the same error. Then I start with the same blockchain data and create a new empty wallet (no funds, no open channels) and all is working nice. After this I recover my old Wallet .. and the same error.

After this I recover my old Wallet .

what steps/commands did you perform when you did this?

Me too, same error
https://termbin.com/w0a5

@fluidvoice  like Just like this explains

Recover LND data
https://github.com/rootzoll/raspiblitz/blob/dc5d8c6ee1968cf5aed98efb9d3ecb0ec8f1b4e1/FAQ.md#1-recover-lnd-data

Me too, same error

C'mon man, you can be more explicit than that.  Which error?  That log file did not have "unable to read bucket" in it.

"edge not found" problem update: https://github.com/rootzoll/raspiblitz/issues/562#issuecomment-497939315

Please close this issue.


Adding angular4 as a peer dependency.

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
Adds support for angular ^4.0.0

It will work but npm will warn about a peer dependency missing. If you use npm shrinkwrap, it won't work at all without the peer dependency being set.

can you merge and release this  branch on production?

Today evening.

Hi @vangorra
I made merge via command line into the new repo and run npm install. The installed version of Angular was 2.4.10, so the bundle's build was based on it.
Can you explain how can I use version ^4.0.0 from the given semver range in "@angular/core": "^2.4.4 || ^4.0.0"?
I have only one idea - update all @angular/... dependencies to version ^4.0.0 such that "@angular/core": "^4.0.0" and etc.

@akserg I'm not entirely sure what error you are mentioning. The benefit to this pull request comes when your project makes use of npm shrinkwrap. Shrinkwrapping locks dependency versions in place, so your build and app will behave predictably even when a dependency introduces a bug in a later minor version.
I have setup some examples that demonstrate how this change will help an angular 4 project.
https://github.com/vangorra/ng2-dnd-examples
The examples demonstrate the following:

ng2 - angular 2 application with ng2-dnd where npm shrinkwrap has been used successfully.
ng4-with-errors - angular 4 application with ng2-dnd where npm shrinkwrap cannot be used as there are errors about peer dependencies.
ng4 - angular 4 application with with ng2-dnd (and this pull request) where npm shrinkwrap has been used successfully.

since the development of this module is stuck at 30th of january and i really needed it for my ng4 project, i published an update on my fork (ng4 update and es5/es2015/umd bundles generation). the modified version is available on npm as ngx-dnd. if anyone interested, feel free to contribute

Done.


fix #856 : Linter added for Code Cleanup

Fixes #856
Linter Added to base location to detect Linting Issues.

Do you see them, too? Can they be resolved?

My bad. I forgot to add the ignorePatterns Property. This error may be fixed now. Can you verify it @aaronreed708 ?

As an addition to Linting, maybe we can also ad Prettier Formatting to this PR if you agree to do so @aaronreed708

#876  is already underway for Prettier with a PR.  No reason that we can't keep them separate.

My bad. I forgot to add the ignorePatterns Property. This error may be fixed now. Can you verify it @aaronreed708 ?

That fixed the parsing error, thank you!

Sure. Shiting the convo to #897


Add Option to copy existing parameters

I added the option to clone existing parameters.
Please review carefully, my first time on this project.
Cheers,
Udo

I also added comObject cloning.
Quick test (incl check with ETS) worked.
On cloning i add a empty Text to the ComObjRef, same as in the add-function:
cref.Text.Add(new Models.Translation(lang, ""));
cref.FunctionText.Add(new Models.Translation(lang, ""))
is this fine or do we need to copy something here?

Thank you.
If it is an auto comonjref i just add empty translations. So everything looks fine.
I testet id and found a bug, but thats on me an i already found a fix for it.

I changed it to
comobj.Text = new ObservableCollection<Translation>(Text.ToList());
comobj.FunctionText = new ObservableCollection<Translation>(FunctionText.ToList());

Works also fine and less code :)

I changed it to
comobj.Text = new ObservableCollection<Translation>(Text.ToList());
comobj.FunctionText = new ObservableCollection<Translation>(FunctionText.ToList());

Works also fine and less code :)

It seems that this doesnt work, i copies just the reference but doesn't any deep copy.  If you now change the Text in die Cloned element, it also changes the Text of the partent.

Yes you are right.
I thought i testet it...


Memory Computation

Hi, I find the paper compare memory(MB) in the table.
Works in model compression field always compare parameters(M) in their results.
So are there any differences and what's memory means?

The compression field always adopts number of parameters (M) while here we adopt the memory consumption of the parameters (MB) following our baseline CEC. For example, if the model has 1M parameters which are stored in 32-bit format, then the memory consumption will be 1M * 32bit = 32Mb = 4MB.

Thanks for your answer!
So does "which are stored in 32-bit format" means the following:
Assuming that the parameters are stored as a floating number, it occupies 4 bytes on a 32-bit system, that is, 32 bits

Yes, 32-bit is the default precision in DL frameworks like pytorch. We also have an experiment setting with 8-bit quantization, where 1M params lead to 1MB memory consumption.

Thanks for replying!


UIMARCAUTH-28: Browse MARC Authority Records > Display Browse headings toggle

Purpose

Hide Advanced search button when Browse segment is selected.
Fix focus on search textarea when toggle segment.

Issue: UIMARCAUTH-28

yarn run v1.22.17
$ eslint .
/home/jenkins/workspace/io-org_ui-marc-authorities_PR-66/project/src/components/KeyShortCutsWrapper/KeyShortCutsWrapper.js
51:6  warning  React Hook useMemo has missing dependencies: 'editShortcuts' and 'searchShortcuts'. Either include them or remove the dependency array  react-hooks/exhaustive-deps
/home/jenkins/workspace/io-org_ui-marc-authorities_PR-66/project/src/components/MultiSelectionFacet/index.js
1:1  error  Dependency cycle via ../../components:9  import/no-cycle
/home/jenkins/workspace/io-org_ui-marc-authorities_PR-66/project/src/components/SearchTextareaField/SearchTextareaField.js
62:6  warning  React Hook useEffect has a missing dependency: 'fitTextBoxToContent'. Either include it or remove the dependency array  react-hooks/exhaustive-deps
✖ 3 problems (1 error, 2 warnings)
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

yarn run v1.22.17
$ eslint .
/home/jenkins/workspace/io-org_ui-marc-authorities_PR-66/project/src/components/KeyShortCutsWrapper/KeyShortCutsWrapper.js
51:6  warning  React Hook useMemo has missing dependencies: 'editShortcuts' and 'searchShortcuts'. Either include them or remove the dependency array  react-hooks/exhaustive-deps
/home/jenkins/workspace/io-org_ui-marc-authorities_PR-66/project/src/components/MultiSelectionFacet/index.js
1:1  error  Dependency cycle via ../../components:9  import/no-cycle
/home/jenkins/workspace/io-org_ui-marc-authorities_PR-66/project/src/components/SearchTextareaField/SearchTextareaField.js
62:6  warning  React Hook useEffect has a missing dependency: 'fitTextBoxToContent'. Either include it or remove the dependency array  react-hooks/exhaustive-deps
✖ 3 problems (1 error, 2 warnings)
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.


Cannot deserialize correctly typed arrays

I have issue on array deserialize when I use the following annotation:
class Test {
    @deserializeAs(String) public arrayOfString: Array<string>;
    @deserializeAs(Number) public arrayOfNumber: Array<number>;
}
var json = {
  arrayOfString: ['String1', 'String2'],
  arrayOfNumber: [1, 2]
}
var test = Deserialize(json, Test);

I get:
'String1,String2' in test.arrayOfString when I expected ['String1', 'String2']
NaN in test.arrayOfNumber when I expected [1, 2]
When I use the following annotation, it works fine:
class Test {
    @deserialize public arrayOfString: Array<string>;
    @deserialize public arrayOfNumber: Array<number>;
}

The reason why I use deserializeAs instead of deserialize is to make your library take care to the type conversion.
Is there a way I can use your library to manage this?
Regards,

Just for information, I check in the library, it seems that you can fix this issue adapting deserializeObject function:
do the if (Array.isArray(source)) in first position instead of second position:
if (Array.isArray(source)) {
instance[keyName] = deserializeArray(source, metadata.deserializedType || null);
} else if (metadata.deserializedType && typeof metadata.deserializedType.Deserialize === "function") {
instance[keyName] = metadata.deserializedType.Deserialize(source);
}
I don't know what will be the impact on the behavior of cerialize in other cases.
Please keep me informed if the solution is correct and can be integrated in a next version of cerialize.
Regards,

As far as I can tell the library is doing the right thing. We don't want to do the array check first because we need to prioritize custom deserializers. As a rule you shouldn't be use xxxxAs annotations on primitive data unless you need to change the key or want custom behavior. I'm not sure I understand what you mean by having the library take care of the type conversion. Can you elaborate?

The issue we have is if we do not specify @deserializeAs(String), if the data doesn't contain a String but a Number, we will not have a string in the object created by Cerialize but a Number.
Specifying @deserializeAs(String), Cerialize will convert the number into a string, it is what we expect.
But in the case of an array of string, the array is converted into a string not into an array of string.

So you are trying to cast a number to a string when deserializing? (or vice versa)

Hello,
We have the case yes (cast string into number).
We are converting XML message to json and then json to object with
cerialize.
The XML do not contains schema so number are strings in the json and
cerialize is not casting the string into number if we do not sepcify:
autoserializeAs(Number).
2016-10-06 13:08 GMT+02:00 weichx<EMAIL_ADDRESS>
So you are trying to cast a number to a string when deserializing? (or
vice versa)
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/weichx/cerialize/issues/36#issuecomment-251932630,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA20QuUmeIBlfiUlp5bD8P5zGIk5qRVhks5qxNa_gaJpZM4KNzpv
.

Got it, so I think this particular use case isn't ideal to provide as built in functionality. What you can do is write a string array to number array (or vice versa) function and pass that in to deserializeAs Here is an example:

function StringConverter(array : string[]) : number[] {
    return array.map((item) => { return parseInt(item) } );
}

 function NumberConverter(array : number[]) : string[] {
      return array.map((item) => { return item.toString() });
 }

 class Test {
     @deserializeAs(StringConverter) public arrayOfString: Array<string>;
     @deserializeAs(NumberConverter) public arrayOfNumber: Array<number>;
 }

@BUONJG does that help you?

Hello,
Sorry for my late response.
It helps but it is not satisfactory for me.
We are using cerialize each time we have to convert a json to a typed object.
The json data has various origins (XML files, No SQL data storage, web forms data, http request body, query parameters....)
In many case, the can't ensure that the json properties are set with the correct type.
We can make Cerialize help a lot here always specifying @deserializeAs( xxx ) event if xxx if String, Number or Boolean.
It works fine when property is not an array of value types.
But when it is an array, the behavior is not correct (Array of string is converted to a string where array value are concatenated)
As I told you, we fixed this on your library making the check source is an array in first place but I understand it has an impact on other behaviors of the library (we don't use)
But I believe String, Number, Boolean should be manage as any other object types for instance in your documentation regarding dates the usage is:
class Test {
     @deserializeAs(Date) public singleDate: Date;
     @deserializeAs(Date) public arrayOfDates: Array<Date>;
 }

why not the same usage for String, Number and Boolean?
Regards,

I see your point, they should respect the given type if provided explicitly. I'll handle this soon

Thank you very much.
Have a good day.
2016-10-12 11:40 GMT+02:00 weichx<EMAIL_ADDRESS>
I see your point, they should respect the given type if provided
explicitly. I'll handle this soon
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/weichx/cerialize/issues/36#issuecomment-253166844,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA20QlvoUxgYkVUVVhyF4ihe-pqBkvpEks5qzKsAgaJpZM4KNzpv
.

this should be working now, at least for deserializing


Enabled codecov features for GitHub actions

Made following changes:

Created coverage XML file
Added codecov upload mechanism

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@28defd9). Click here to learn what that means.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff            @@
##             master       #2   +/-   ##
=========================================
  Coverage          ?   96.34%
=========================================
  Files             ?        6
  Lines             ?      246
  Branches          ?        0
=========================================
  Hits              ?      237
  Misses            ?        9
  Partials          ?        0

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


After Rebooting all my Control Plane Nodes at the same time: ovn-central  details":"inconsistent data","error":"ovsdb error"

How do we recover from the following condition?
PROBE_INTERVAL is set to 180000
OVN_LEADER_PROBE_INTERVAL is set to 5
OVN_NORTHD_N_THREADS is set to 1
ENABLE_COMPACT is set to false
<IP_ADDRESS>

ovn-northd is not running
ovnnb_db is not running
ovnsb_db is not running
ovsdb-tool: /etc/ovn/ovnnb_db.db: record 175 attempts to truncate log from 1873 to 1839 entries, but commit index is already 1872
backup /etc/ovn/ovnnb_db.db to /etc/ovn/ovnnb_db.db.backup-1713236899-d612f5
detected database corruption for file /etc/ovn/ovnnb_db.db, try to fix it.
ovsdb-tool: /etc/ovn/ovnnb_db.db: record 175 attempts to truncate log from 1873 to 1839 entries, but commit index is already 1872
[{"uuid":["uuid","41001f66-a798-438c-b29f-d308c8b4f853"]},{"uuid":["uuid","d6d7e922-1438-40f8-ab60-6b96b09bd538"]}]
[{"uuid":["uuid","58250fbc-e394-43b0-8d66-be020227f6ce"]},{"uuid":["uuid","7775de3b-d03c-45ae-b9da-74a39b50ea0b"]}]
2024-04-16T03:08:19Z|00001|stream_ssl|ERR|Private key must be configured to use SSL
2024-04-16T03:08:19Z|00002|stream_ssl|ERR|Certificate must be configured to use SSL
2024-04-16T03:08:19Z|00003|stream_ssl|ERR|CA certificate must be configured to use SSL
ovsdb-client: failed to connect to "ssl:[<IP_ADDRESS>]:6641" (Protocol not available)
2024-04-16T03:08:19Z|00001|stream_ssl|ERR|Private key must be configured to use SSL
2024-04-16T03:08:19Z|00002|stream_ssl|ERR|Certificate must be configured to use SSL
2024-04-16T03:08:19Z|00003|stream_ssl|ERR|CA certificate must be configured to use SSL
ovsdb-client: failed to connect to "ssl:[<IP_ADDRESS>]:6641" (Protocol not available)
2024-04-16T03:08:19Z|00001|stream_ssl|ERR|Private key must be configured to use SSL
2024-04-16T03:08:19Z|00002|stream_ssl|ERR|Certificate must be configured to use SSL
2024-04-16T03:08:19Z|00003|stream_ssl|ERR|CA certificate must be configured to use SSL
ovsdb-client: failed to connect to "ssl:[<IP_ADDRESS>]:6641" (Protocol not available)
Starting ovsdb-nb
ovn-nbctl: unix:/var/run/ovn/ovnnb_db.sock: database connection failed ()
2024-04-16T03:08:19Z|00001|reconnect|INFO|unix:/var/run/ovn/ovnnb_db.sock: connecting...
2024-04-16T03:08:19Z|00002|reconnect|INFO|unix:/var/run/ovn/ovnnb_db.sock: connected
Waiting for OVN_Northbound to come up
Starting ovsdb-sb
ovn-sbctl: unix:/var/run/ovn/ovnsb_db.sock: database connection failed ()
2024-04-16T03:08:20Z|00001|reconnect|INFO|unix:/var/run/ovn/ovnsb_db.sock: connecting...
2024-04-16T03:08:20Z|00002|reconnect|INFO|unix:/var/run/ovn/ovnsb_db.sock: connected
Waiting for OVN_Southbound to come up
Starting ovn-northd
2024-04-16T03:08:21Z|00002|ovsdb_idl|WARN|transaction error: {"details":"inconsistent data","error":"ovsdb error"}
ovn-nbctl: transaction error: {"details":"inconsistent data","error":"ovsdb error"}
Exiting ovn-northd (673)
Exiting ovnnb_db (280)
Exiting ovnsb_db (483)

It appears this is only happening on 1 pod which is on headnode-01
[ use1 ] root@headnode-01:~$ kubectl ko nb status
faf1
Name: OVN_Northbound
Cluster ID: 277c (277c6d46-33b1-42b7-83be-4457951d8c54)
Server ID: faf1 (faf1ae0a-1103-48b4-993e-b06aab97f168)
Address: ssl:[<IP_ADDRESS>]:6643
Status: cluster member
Role: leader
Term: 20
Leader: self
Vote: self

Last Election started 44557 ms ago, reason: timeout
Last Election won: 44555 ms ago
Election timer: 5000
Log: [1802, 3219]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: (->ebb1) ->48ff <-48ff
Disconnections: 3
Servers:
    ebb1 (ebb1 at ssl:[<IP_ADDRESS>]:6643) next_index=3219 match_index=3218 last msg 13984 ms ago
    48ff (48ff at ssl:[<IP_ADDRESS>]:6643) next_index=3219 match_index=3218 last msg 650 ms ago
    faf1 (faf1 at ssl:[<IP_ADDRESS>]:6643) (self) next_index=3216 match_index=3218
status: ok

[ use1 ] root@headnode-01:~$ kubectl ko sb status
9e2c
Name: OVN_Southbound
Cluster ID: 7da9 (7da9f927-2c1d-4160-94c2-5be40d54cb81)
Server ID: 9e2c (9e2cd89b-5a30-4ae4-b3b8-7dfbd659ca53)
Address: ssl:[<IP_ADDRESS>]:6644
Status: cluster member
Role: leader
Term: 20
Leader: self
Vote: self

Last Election started 133221 ms ago, reason: timeout
Last Election won: 133218 ms ago
Election timer: 5000
Log: [1869, 3584]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: (->6919) ->81a3 <-81a3
Disconnections: 5
Servers:
    6919 (6919 at ssl:[<IP_ADDRESS>]:6644) next_index=1918 match_index=3583 last msg 21212 ms ago
    81a3 (81a3 at ssl:[<IP_ADDRESS>]:6644) next_index=3584 match_index=3583 last msg 1600 ms ago
    9e2c (9e2c at ssl:[<IP_ADDRESS>]:6644) (self) next_index=3580 match_index=3583
status: ok

Γöé kube-system     ovn-central-868c6dc8c7-f9sr5      ΓùÅ      0/1       CrashLoopBackOff                 3       0       0          0          0          0          0 <IP_ADDRESS>      headnode-01      116s       Γöé
Γöé kube-system     ovn-central-868c6dc8c7-jfkzp      ΓùÅ      1/1       Running                          0      46      70         15          1         35          1 <IP_ADDRESS>      headnode-02      2m6s       Γöé
Γöé kube-system     ovn-central-868c6dc8c7-kl45v      ΓùÅ      1/1       Running                          0      88      74         29          2         37          1 <IP_ADDRESS>      headnode-03      2m2s       Γöé

please see the doc: https://kubeovn.github.io/docs/v1.13.x/ops/recover-db/

@bobz965  Great!    Kick From cluster worked perfectly.     Tried deleting a eip and fip.....   not found.
E0416 14:08:14.390556       1 ovn-nb-nat.go:302] not found logical router ovn-cluster nat 'type dnat_and_snat external ip <IP_ADDRESS> logical ip <IP_ADDRESS>'
E0416 14:08:14.390587       1 ovn-nb-nat.go:214] not found logical router ovn-cluster nat 'type dnat_and_snat external ip <IP_ADDRESS> logical ip <IP_ADDRESS>'
E0416 14:08:14.390600       1 ovn_fip.go:464] failed to delete fip eip-static, not found logical router ovn-cluster nat 'type dnat_and_snat external ip <IP_ADDRESS> logical ip <IP_ADDRESS>'
E0416 14:08:14.390645       1 ovn_fip.go:172] error syncing 'eip-static': not found logical router ovn-cluster nat 'type dnat_and_snat external ip <IP_ADDRESS> logical ip <IP_ADDRESS>', requeuing
I0416 14:08:25.356517       1 ovn_eip.go:324] handle del ovn eip eip-static
E0416 14:08:25.356582       1 ovn_eip.go:637] ovn eip 'eip-static' is still in use, finalizer will not be removed
E0416 14:08:25.356596       1 ovn_eip.go:348] failed to handle remove ovn eip finalizer , ovn eip 'eip-static' is still in use, finalizer will not be removed
E0416 14:08:25.356635       1 ovn_eip.go:204] error syncing 'eip-static': ovn eip 'eip-static' is still in use, finalizer will not be removed, requeuing

Restarting all 3 of the ovn-central pods allowed the kubectl ko command to function as expected.  I assume its ttempting to execute this command on an old leader or?

 "_" I think the database is gone?
[ use1 ] root@headnode-02:~$ k ko nbctl show [ use1 ] root@headnode-02:~$

i think you should kick the bad one, and then clean its nb db and sb db data, and add it back.

should be fixed by #3928


it has onimageupload & insertimage?

i try to insert & onimageupload event in summernote.
but it can't
i found some document at this site. i.. can't see insert & onimageupload event.
only i can see that  $scope.imageUpload = function(files) {
console.log('image upload:', files);
console.log('image upload's editable:', $scope.editable);
}..
i'm wrong? please let me know.
thank you very much.

You need to upload the image into your server and make a image node and then insert it in editor.
<summernote on-image-upload="imageUpload(files)" editor="editor"></summernote>

$scope.imageUpload = function(files) {
  // upload images to your server
  var imgNode = $('<img>').attr('src', 'https://assets-cdn.github.com/images/modules/dashboard/bootcamp/octocat_setup.png')[0];
  $scope.editor.summernote('insertNode', imgNode);
};

wow..thanks a lot


[REG2.064] Issue 14089 - Assigning to AA has no value when overriding opAssign

https://issues.dlang.org/show_bug.cgi?id=14089
When I fixed issue 6178 in #2539, I could not find the way to avoid false "dovar has no side effect" error for the test case in runnable/testaa.d. Now, I found a way that loosen discardValue() behavior a little for CondExp.

This looks wrong.  Won't it now miss cases where the user actually did accidentally discard a value?
Can you give some more info on the invalid side effect error it was generating?

Can you give some more info on the invalid side effect error it was generating?

You can see the cases in fail_compilation/fail14089.d.

No, I mean the errors from the AA indexing lowering that require these workarounds in the first place.  I'm not so sure that eg cond ? (n = 1) : 1; shouldn't be an error.

Auto-merge toggled on

This PR seems to broke opAssign whose return type is different from the object. https://issues.dlang.org/show_bug.cgi?id=14144


IMU calibration routines are incorrect

Hi! Thanks a lot for making the PSMoveService. It's a great library and very useful to the VR community. I really appreciate everyone who worked on it. I've posted a similar issue to the PSVRTracker github repository, as the relevant code is essentially the same.
I've been trying to track down an issue that I've started experiencing in a software that uses PSMoveService called iVRy, and I've figured out where the issue lies within PSMoveService.
In this file:
ServerRequestHandler.cpp#L2887-L2893
you compare the measured gravity vector to a straight down vector, create a difference vector (raw_accelerometer_bias), and then you calibrate everything by adding that difference. So in MorpheusHMD.cpp you do CalibratedAccel = raw_accel - raw_accelerometer_bias (I don't include the .i .j .k and X Y Z). You do it the same way for both accel and gyro.
That is however not correct. I'll explain below what that affects, but first let me present how the calibration could be done in a better way. You would find the rotation between the measured gravity vector, and the ideal straight-down gravity vector, and then you would find a linear matrix (call it rotCal) that rotates the measured gravity into the straight-down vector. Only after that rotation is performed, should you perform any scaling - not before. After you do the rotation, take measured_g, rotate it by the matrix, and figure out its length - the inverse of that number is your scaling calibration number for the accelerometer, call it accelScale. Next up, to calibrate the gyro, take the raw gyro data, and rotate it with rotCal. After this, get the numbers from the gyro, and those are your bias numbers (call that rotated_gyro_bias).
The difference might not be big for most headsets, however I have a headset where the IMU's internal MEMS gyroscope seems to have drifted out to a pretty steep angle. It has a clear measurement error when using PSMoveService, however it works perfectly when used with the PS4 using Sony's algorithms. I've found out that those IMU chips actually don't have any guarantee of how they will drift and it's normal for them to drift out of calibration over time. At first the author of iVRy said my IMU might be broken or maybe it moved physically, but I took apart my PSVR v2 and the IMU is located in such a way that the PCB (printed circuit board) can't move at all, not one bit, and it's not physically broken. So I figured that the IMU might have drifted internally and sure enough, that is a common mode of operation for those chips. It's not a mode of failure as the chip didn't fail - it is expected to do that. Essentially, there are tiny gyroscopes inside the chip, and the angle at which those rotate can change over time. This is what happens to all these chips, and in my case it's stronger than in other headsets.
So this is what the headset looks like with just basic calibration. You can see that the view is permanently tilted to the side. And if you try to calibrate it using the code that exists in PSMoveService as of today, this is what it looks like. As you can see, if you look straight ahead it looks good, however, if you turn your head, then two things are apparent. First of all, the raw_accelerometer_bias is applied incorrectly when the head is turned 90 degrees to either side, making the tilt worse. Second of all, there's this weird drift that happens right after the headset is moved. This is because of how raw_gyro_bias is calculated currently.
So the fix is to instead rotate the data coming from the IMU, because physically, that's what happens - it's almost as if the PCB inside the headset is at an angle. Here's a good a good link to how you can quickly calculate the rotation matrix between two vectors (Math Stackexchange).
So the pseudocode for the new calibration would be roughly like you can see below. Bear in mind I'm not a C++ programmer, so the &s and *s might be wrong.
/* ClientGeometry_CAPI.h */

/* 3x3 matrix of floats with this shape:
a b c
d e f
g h i
*/
typedef struct
{
    float a, b, c, d, e, f, g, h, i;
} PSMMat33f;

/* Finds a matrix that rotates `from` to `to`, without changing its
length - the length of `from` after rotation might be different
than the length of `to`, but they will point in the same direction.
See Math Stackexchange link above for details on how to
implement this function. */
PSM_PUBLIC_FUNCTION(PSMMat33f) PSM_Vector3fFindRotMat(const PSMVector3f *from, const PSMVector3f *to);

/* Rotates vector `a` by matrix `m`. This is just matrix-vector multiplication that results in a new vector. */
PSM_PUBLIC_FUNCTION(PSMVector3f) PSM_Vector3fRot(const PSMMat33f *m, const PSMVector3f *a);

/* ServerRequestHandler.cpp */

void handle_request__set_hmd_accelerometer_calibration(...)
{
    ...
    const PSMVector3f *ideal_g = {0, 0, 1}; /* the ideal downwards gravity vector. I don't know which axis is downwards, so I assumed it is z=1. */
    ...
    PSMMat33f *rotCal = PSM_Vector3fFindRotMat(&measured_g, &ideal_g);
    PSMVector3f *rotated_g = PSM_Vector3fRot(&rotCal, &measured_g);
    float accelScale = 1/sqrtf(rotated_g.x*rotated_g.x + rotated_g.y*rotated_g.y + rotated_g.z*rotated_g.z);

    /* you store rotCal and accelScale in the calibration data */
    ...
}

void handle_request__set_hmd_gyroscope_calibration()
{
    ...
    /* note that I've renamed raw_bias to raw_gyro.

    I've also added rotCal, it comes from handle_request__set_hmd_accelerometer_calibration.
    for this reason handle_request__set_hmd_accelerometer_calibration must run before
    handle_request__set_hmd_gyroscope_calibration. */

    const PSMVector3f *rotated_gyro = PSM_Vector3fRot(&rotCal, &raw_gyro);
    set_config_vector(rotated_gyro, config->rotated_gyro_bias); /* note that there is no raw_gyro_bias any more. */
    ...
}

/* MorpheusHMD.cpp */

void MorpheusHMDSensorFrame::parse_data_input(...)
{
    ...
    PSMVector3f *raw_accel = { raw_accelX, raw_accelY, raw_accelZ };
    PSMVector3f *raw_gyro = { raw_gyroYaw, raw_gyroPitch, raw_gyroRoll };
    ...
    RotatedAccel = PSM_Vector3fRot(config->rotCal, raw_accel);
    CalibratedAccel = PSM_Vector3fScale(&RotatedAccel, config->accelScale);
    ...
    RotatedGyro = PSM_Vector3fRot(config->rotCal, raw_gyro);
    CalibratedGyro = PSM_Vector3fAdd(&RotatedGyro, &config->rotated_gyro_bias);
    ...
}

Note one thing. When calibrating the accelerometer, you can only ever get the scaling in one direction. To fully calibrate in x, y, and z, you would have to have a 3D jig that can rotate the headset so the gravity is first downward (normal calibration), then so gravity is towards the side of the headset, and then once more so that gravity is towards the front of the headset. It's crucial that you rotate the headset by a somewhat precise angle of 90 degrees. You could do that by making a box to put the headset in. The box has 90 degree angles, so you will be able to rotate it on its sides and it will stay in the right position. However, for this to be correct, the headset would need to sit tightly inside the box. For this reason you could create small cardboard cutouts that you stick in the box, and the headset rests on them.
Also note that you could theoretically calibrate the gyro scaling, but to do that you would need to put the headset-in-a-box (like described above) on a motorized turntable with a revolution sensor to measure the angular velocity of the turntable. A revolution sensor tells you when a full revolution of the turntable has happened. It can be done cheaply. In that case, during calibration, you would first calculate rotated_gyro as above, then config->rotated_gyro_bias as above, and then after that you would calibrate the scaling for each of the 3 rotation axes, in separate runs.
One more thing to note. I assume that the accelerometer measures the gravity vector with no bias (ie constant component), and I assume there's just a scaling error. This is somewhat of a large assumption. To properly test it, you would need to put the IMU in vertical free fall to see if it registers any sort of bias, and then you could figure out the bias and scaling separately. You would have to perform the test in all three directions. This is however not very practical. And without that, you can only assume either a bias or a scaling error, and I assume a scaling error. With a bit of work towards automatically cleaning up the sensor data, you essentially could drop the headset inside like a soft foam carrying case, and nothing bad would happen to it, mechanically speaking. As in it wouldn't break. But it would be a bit more involved than the code above, you would have to cull the recorded data to just the period where it's clearly in free fall (which can be detected), and you would have to somehow correct for the pull of the cable and make sure that it's not rotating at the same time - or use the rotation as an additional source of data, and calculate the calibration that way. It's an interesting problem in classical mechanics, that's for sure, but it's by no means very difficult. Another thing you could do is put the headset on the perimeter of a round turntable - in that case it would always be experiencing some sort of acceleration, which you could calculate on paper, and compare to what the headset's IMU has measured. The turntable would not only need a revolution sensor (i.e. a sensor that tells you when the turntable has turned a full 360 degrees), but also a position sensor that measures the angle at which the turntable is with precision comparable to the 2000Hz sampling rate the headset's IMU works at.
Another thing is the fact that even after all this calibration, a short term calibration will not find the long term drift that happens when using PSMoveService. Invariably it's a drift to the left, like you're slowly turning your head to the right, and it is only noticeable after 10 minutes or so, but it is invariably there and in all headsets. I think it should be calibrated separately from the calibrations described above. I think the source of this drift might be either integration error in PSMoveService (i.e. when you add floats many many times over, then there's a statistical error that becomes more significant over an hour or so), or it could be an intrinsic data bias in the output of the IMU being used in the PSVR. I think it should be calibrated separately because properly calibrating it away takes at least 10 minutes of measurement, and so you should be able to perform the quick calibrations described above in the pseudocode without erasing the long-term-drift calibration data, which takes ages to do, so people won't want to do this every time they turn on the headset. However, that is a conversation for another time. Thanks for reading this very long post! And thanks for your work!

Hi @cheater ,
This all seems like great information.
Unfortunately, I haven't used my PSMove controllers in years and I don't see when I'll have time to test this out. If you can put together a pull request then I can make a test build and upload it and ask users to try it out. If it seems to work then I can add it to the release page.

Hi @cboulay, thanks. This is specifically about the PSVR headset - why are PSMove controllers relevant? Thanks

Some of the code is common across devices. Any fix for PSVR would have to not-break PSMove controllers. I'm optimistic that it could also improve PSMove controller operation.

Sorry, I didn't fully understand the scope of the proposed changes. I don't have a PSVR and I've never looked at the HMD-exclusive code. I thought this was a more fundamental change to the way the IMU was calibrated. But it seems like it's scoped to only the HMD. In that case, I would have no way to test it.

Some of the code is common across devices. Any fix for PSVR would have to not-break PSMove controllers. I'm optimistic that it could also improve PSMove controller operation.
Sorry, I didn't fully understand the scope of the proposed changes. I don't have a PSVR and I've never looked at the HMD-exclusive code. I thought this was a more fundamental change to the way the IMU was calibrated. But it seems like it's scoped to only the HMD. In that case, I would have no way to test it.

If this code is representative of IMU calibration in other places in this code (including PSMove and other devices, even non-Sony) then it likely all needs to be updated in this way. However, it's lucky that the changes aren't /huge/ per se.

Can you suggest an open source project that uses PSMoveService to provide SteamVR tracking for the PSVR? If I can get that to build, then maybe I could try to make this into a PR.

I've also had another question. For both the accelerometer and gyroscope, you store the data variance during calibration. What is that used for?

I'm asking about the variance because depending on what it is used for, it may have to be re-calculated after calibration is complete.

Can you suggest an open source project that uses PSMoveService to provide SteamVR tracking for the PSVR?

Maybe https://github.com/HipsterSloth/PSMoveSteamVRBridge ?
I've never used a PSMove via SteamVR so I don't know how this works.
I haven't heard from him in a while, but maybe @HipsterSloth knows.


Crunchyroll no longer working

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2<IP_ADDRESS>. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[ x] I've verified and I assure that I'm running youtube-dl 2<IP_ADDRESS>

Before submitting an issue make sure you have:

[x ] At least skimmed through README and most notably FAQ and BUGS sections
[x ] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
youtube-dl --all-subs  -u (hidden) -p (hidden) -v http://www.crunchyroll.com/bungo-stray-dogs
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--all-subs', u'-u', u'PRIVATE', u'-p', u'PRIVATE', u'-v', u'http://www.crunchyroll.com/bungo-stray-dogs']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2<IP_ADDRESS>
[debug] Python version 2.7.10 - Darwin-16.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.2.4, ffprobe 3.2.4, rtmpdump 2.4
[debug] Proxy map: {}
[crunchyroll:playlist] Downloading login page
ERROR: Unable to download webpage: HTTP Error 503: Service Temporarily Unavailable (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 496, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2093, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: http://www.crunchyroll.com/bungo-stray-dogs
Playlist: http://www.crunchyroll.com/bungo-stray-dogs/episode-1-fortune-is-unpredictable-and-mutable-702635

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.
Description of your issue, suggested solution and other information
the crunchyroll support doesn't seem to be working when trying to use a login to get higher than 480p quality.
this does require a premium account to test, but you can get 14 free days, either by entering a card, or you can use the app to get two 7 day trials (one premium, one premium
this problem works with any crunchyroll URL

Duplicate of #11572.

sorry for posting a duplicate


release/0.0.2

👷 Deploy Preview for alexis-mora processing.
🔨 Explore the source changes: 4929b9b097f75b6627564a879298cf8eca4a1a62
🔍 Inspect the deploy log: https://app.netlify.com/sites/alexis-mora/deploys/610f8467188f0b0007c74ff7


Added option for computing anti-stabilizing solutions of Riccati equations

Sometimes also anti-stabilizing solutions of Riccati equations are of interest. The slicot routine offers to compute these solutions, so I added an option in the care and dare routine, which both default back to the stabilizing case.

Coverage decreased (-13.4%) to 65.029% when pulling cf77e2350ac014fd13a3c1c1dd4884a859f59c60 on dbacc:master into 31e694441dbb101f7e601dce2b8dfa3e97ec2a1a on python-control:master.

Can you please add unit tests to demonstrate the new functionality?

Sure, done ;)

Thanks for your contribution!  The unit test needs to go in control/tests and use the unittest framework.  I suggest adding this to statefbk-test.py since that is where other unit tests associated with controller synthesis currently live.

now it should be at the correct location ;)
btw. Why is @coveralls telling that coverage decreased?

@dbacc Can you merge changes from latest master to get Travis CI working again (see PR #280 for more info).  Thanks.

Changes look good.  Will include in 0.8.2 release after verifying there are no conflicts.


new: added code coverage token

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@a2bff9e). Click here to learn what that means.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@           Coverage Diff            @@
##             main        #2   +/-   ##
========================================
  Coverage        ?   100.00%
========================================
  Files           ?         7
  Lines           ?       634
  Branches        ?         0
========================================
  Hits            ?       634
  Misses          ?         0
  Partials        ?         0


Adding question in One Dimensional Array

I want to add the question of the maximum sum of a subarray in the database of One Dimensional array. Link to the question https://leetcode.com/problems/maximum-subarray/

@Saviour1001 please get started.

@Saviour1001 please get started.

Can i work on this issue @Abhijit2505 if @Saviour1001 is not working on it.

Can i work on this issue @Abhijit2505 if @Saviour1001 is not working on it.

@sammy8825 I am sorry but right now my exams are going on at the moment and thus I am focussed on them. I will finish this soon.

@sammy8825 I am sorry but right now my exams are going on at the moment and thus I am focussed on them. I will finish this soon.

Can I work on this issue?

Can I work on this issue?

Created a pull request #75 to solve the issue

Created a pull request #75 to solve the issue


Add support for top-level type declarations

This also updates the Context to track type declarations and variable declarations separately.

Codecov Report

Merging #75 (1fa4d52) into main (d738747) will increase coverage by 0.85%.
The diff coverage is 96.48%.

@@            Coverage Diff             @@
##             main      #75      +/-   ##
==========================================
+ Coverage   89.36%   90.22%   +0.85%
==========================================
  Files          21       21
  Lines        2125     2168      +43
==========================================
+ Hits         1899     1956      +57
+ Misses        226      212      -14

Impacted Files
Coverage Δ

src/ast/expr.rs
66.66% <ø> (ø)

src/lib.rs
0.00% <0.00%> (ø)

src/main.rs
50.00% <ø> (+50.00%)
:arrow_up:

src/parser/jsx.rs
100.00% <ø> (ø)

src/infer/infer_mem.rs
93.61% <83.33%> (-1.51%)
:arrow_down:

src/codegen/d_ts.rs
81.09% <90.47%> (+0.96%)
:arrow_up:

src/infer/constraint_solver.rs
90.94% <93.75%> (-0.17%)
:arrow_down:

tests/integration_test.rs
98.31% <99.13%> (+0.08%)
:arrow_up:

src/codegen/js.rs
88.84% <100.00%> (+0.04%)
:arrow_up:

src/infer/context.rs
97.01% <100.00%> (-0.05%)
:arrow_down:

... and 6 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d738747...1fa4d52. Read the comment docs.


CSS / SCSS / SASS

Not so much a bug, but perhaps a useful addition.
When defining custom theme, it would be useful to not be limited to CSS only (which seems to be the case), custom theme is not loaded unless it is CSS (so SCSS, does not load for me). I tried both absolute and relative URL, and neither seems to be recognised unless it is CSS.

Not entirely sure what you mean - are you using a javascript scss compiler?

theme:false but still loading css from cdn

Sorry for late reply. What I mean is that this works:

SASS is a CSS preprocessor. This means that you have to run it through a compiler (such as node-sass) and it will transform it to CSS.
The browser itself has no concept of knowing how to deal with SASS, as such uploading the SCSS file to the server would serve no purpose.


rss-bridge: 2022-06-14 -> 2023-09-24

Description of changes
Update to the latest release: https://github.com/RSS-Bridge/rss-bridge/releases/tag/2023-09-24
The source code substitutions have to be adopted to continue working. The PATH_CACHE const has to use define instead, as const forbids using functions.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

@dawidsowa

@Mynacol i think you need to add yourself in maintainers/maintainer-list.nix if not already there. And afterwards in meta.maintainers for the package.


NUTCH-2845 Complete rules of urlfilter-suffix

add more excluded file suffixes for

images
audio and video formats
software packages and archives
fonts

Below the mapping of file suffixes to file formats or MIME types:
.3g2	3GPP2 Multimedia
.3gp	video/3gpp
.afm	application/x-font-adobe-metric
.aif	audio/x-aiff
.aiff	audio/x-aiff
.apk	application/vnd.android.package-archive
.avif	video/quicktime
.bz2	application/x-bzip2
.crx	application/x-chrome-package
.dll	Microsoft dynamic-link library
.dmg	Apple Disk Image
.egg	Egg Python package
.f4v	video/quicktime
.flac	audio/x-flac
.gblorb	audio/x-aiff
.gifv	image/gif
.icns	Apple Icon Image
.ipk	Debian software installation package
.jp2	image/jp2
.jpf	image/jpx
.jpx	image/jpx
.js	application/javascript
.kdc	image/x-raw-kodak
.lzma	application/x-lzma
.m3u8	audio/x-mpegurl
.m4a	video/mp4
.m4r	iPhone Ringtone
.m4v	video/x-m4v
.mar	Mozilla Archive
.mk3d	Matroska 3D Video
.mka	Matroska Audio
.mks	Matroska Elementary Stream
.mkv	video/x-matroska
.movie	video/x-sgi-movie
.mp4	video/mp4
.mp4a	audio/mp4
.mpga	audio/mpeg
.oga	audio/vorbis
.opus	audio/opus
.otf	application/x-font-otf
.pfb	application/x-font-type1
.qt	Apple QuickTime Movie
.rar	application/x-rar-compressed
.svg	image/svg+xml
.svgz	image/svg+xml
.ttf	application/x-font-ttf
.udeb	application/x-debian-package
.webm	video/webm
.webp	image/webp
.whl	Wheel Python package
.woff	application/font-woff
.woff2	application/font-woff2
.xm	audio/xm
.xz	application/x-xz

Below the mapping of file suffixes to file formats or MIME types:
.3g2	3GPP2 Multimedia
.3gp	video/3gpp
.afm	application/x-font-adobe-metric
.aif	audio/x-aiff
.aiff	audio/x-aiff
.apk	application/vnd.android.package-archive
.avif	video/quicktime
.bz2	application/x-bzip2
.crx	application/x-chrome-package
.dll	Microsoft dynamic-link library
.dmg	Apple Disk Image
.egg	Egg Python package
.f4v	video/quicktime
.flac	audio/x-flac
.gblorb	audio/x-aiff
.gifv	image/gif
.icns	Apple Icon Image
.ipk	Debian software installation package
.jp2	image/jp2
.jpf	image/jpx
.jpx	image/jpx
.js	application/javascript
.kdc	image/x-raw-kodak
.lzma	application/x-lzma
.m3u8	audio/x-mpegurl
.m4a	video/mp4
.m4r	iPhone Ringtone
.m4v	video/x-m4v
.mar	Mozilla Archive
.mk3d	Matroska 3D Video
.mka	Matroska Audio
.mks	Matroska Elementary Stream
.mkv	video/x-matroska
.movie	video/x-sgi-movie
.mp4	video/mp4
.mp4a	audio/mp4
.mpga	audio/mpeg
.oga	audio/vorbis
.opus	audio/opus
.otf	application/x-font-otf
.pfb	application/x-font-type1
.qt	Apple QuickTime Movie
.rar	application/x-rar-compressed
.svg	image/svg+xml
.svgz	image/svg+xml
.ttf	application/x-font-ttf
.udeb	application/x-debian-package
.webm	video/webm
.webp	image/webp
.whl	Wheel Python package
.woff	application/font-woff
.woff2	application/font-woff2
.xm	audio/xm
.xz	application/x-xz

Hi @sebastian-nagel I'm curious. Does Tika not process these files or do we generally just want to avoid them? Thanks

Hi @sebastian-nagel I'm curious. Does Tika not process these files or do we generally just want to avoid them? Thanks

For example, we were planning on starting work on https://issues.apache.org/jira/browse/TIKA-94 which would facilitate extraction of text from more multimedia. Thanks for any insights.

For example, we were planning on starting work on https://issues.apache.org/jira/browse/TIKA-94 which would facilitate extraction of text from more multimedia. Thanks for any insights.

Hi @lewismc, the template rules of urlfilter-suffix already include suffixes typically indicating image, video, package and binary formats. But the suffix set dates back to 2006 (34067f7), so this PR adds suffixes for recent formats, e.g. if .png and .jpg are excluded excluded, also .webp should.
Whether or not a crawl shall include multimedia content depends on the use case. By default, urlfilter-suffix is not included in plugin.includes. Even if Tika can extract text from many multimedia and package formats - there's a tradeoff between bandwidth and outcome. While HTML pages are usually small (even smaller with compression during HTTP transfer), crawling multimedia files or software packages can consume a substantial part of your network bandwidth.
But again: it's on the users to enable the suffix filter and to modify the rules at their needs.

Hi @lewismc, the template rules of urlfilter-suffix already include suffixes typically indicating image, video, package and binary formats. But the suffix set dates back to 2006 (34067f7), so this PR adds suffixes for recent formats, e.g. if .png and .jpg are excluded excluded, also .webp should.
Whether or not a crawl shall include multimedia content depends on the use case. By default, urlfilter-suffix is not included in plugin.includes. Even if Tika can extract text from many multimedia and package formats - there's a tradeoff between bandwidth and outcome. While HTML pages are usually small (even smaller with compression during HTTP transfer), crawling multimedia files or software packages can consume a substantial part of your network bandwidth.
But again: it's on the users to enable the suffix filter and to modify the rules at their needs.

Thanks @sebastian-nagel +1

Thanks @sebastian-nagel +1


Doesn't care about Existing Settings

Hi, This install.sh replaces settings of web server (for me nginx) instead of appending necessary changes. Just removes default file from "/etc/nginx/sites-available" which was my server setting file & made me do extra work. There should be a manual method for people already having server setup.

Hello,
Same for me and my apache config.
It break all the extisting configuration...
I try to deploy manually, but not really human friendly :)
Can you desribe how to deploy the webui for the camera without using install.sh script ?
Thanks for your work !

install.sh does quite a lot of things; copying files into different places, setting permissions, arranging boot start up. setting up webserver etc.
If it is just the apache side you are concerned about then maybe the best way is just to stop from installing or touching apache settings. That is  easy to do by setting the webserver  name to anything other than apache, nginx, or lighttpd  when the install.sh runs (e.g. set it to fred). This way the install.sh won't do any webserver installation and won't call fnApache which is where the Apache settings are modified. All the other install stuff will be done including copying the web files under /var/www/html or whichever sub folder you have set.
You then need to do any apache changes yourself manually. You can see what the install.sh would normally do by looking at fnApache. It is basically setting up VirtualHost, port, sites-available and password stuff if required.


Checking super type is broken for generic types

If the type parameter in checkSuperTypes is generic it will have erased supertype and thus type.supertype_field == null. Luckily we can still access the non-erased type thru tsym.
public boolean checkSuperTypes (ClassType type) {
	// generic types have the goodies elsewhere
	if (type.hasErasedSupertypes())
		type=(ClassType)type.tsym.type

	if (type.supertype_field != null && type.supertype_field.tsym != null) {
		if (checkScope(type.supertype_field.tsym.members()))
			return true;
		else
			return checkSuperTypes((ClassType) type.supertype_field);
	}

	return false;
}

Note that this problem affect generic types only if there is at least three or more in the inheritance chain. If there are only two generic classes, then only checkScopes is called and its not affected. Only checkSuperTypes is affected. I believe it boils down to that checkScopes is taking members from JCIdent and the checkSuperTypes from ClassType object.

One more comment. It might be better to replace
    if (type.hasErasedSupertypes())
        type=(ClassType)type.tsym.type

with
    if (type.supertype_field == null)
        type=(ClassType)type.tsym.type

It should be true that type.hasErasedSupertypes() == (type.supertype_field == null) but I am not absolutely sure about this.


Using web3modal with web3-react

So does it work now?
Can we easily use web3modal with web3-react?
I tried doing something like this:
const web3Modal = useWeb3Modal();
const { active, account, library, activate, deactivate } = useWeb3React()
...
const provider = web3Modal.connect();
await activate(provider);

But I get "TypeError: connectors is not iterable"
Is there something we have to do with injectConnectors?
Any help would be greatly appreciated!

With stable version 2.0.0 of Web3Modal now released, we are officially dropping support for version 1.x
Due to this this issue/pr was marked for closing. It is highly recommended to upgrade as 2.x will be receiving further updates that will enable functionality for some of our newer sdks like auth and push as well as support for WalletConnect v2 (See this post about WalletConnect v1 being deprecated https://medium.com/walletconnect/walletconnect-v1-0-sunset-notice-and-migration-schedule-8af9d3720d2e)
If you need to continue using Web3Modal 1.x and require this feature/fix implemented, we suggest adding it via forking V1 branch.


futures just template instead of templateUrl

my resolution strategy just needs a a static template rather than a file.
var fullstate = {
                name: futureState.stateName,
                url: futureState.urlPrefix,
                //templateUrl: futureState.templateUrl,
                template:'
hello world
'    // NOTE : template instead of templateUrl, don't want to create too many templateUrls ; in my case
            };

            d.resolve(fullstate);

This did NOT worked ..

Hmmm, that should work.
Can you show me more code, or a plunker?

sorry working .. was due to some other issue ..can close
Regards,
Shravan
On 10 May 2016 at 03:18, Chris Thielen<EMAIL_ADDRESS>wrote:

Hmmm, that should work.
Can you show me more code, or a plunker?
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
https://github.com/christopherthielen/ui-router-extras/issues/316#issuecomment-218000276


Does block's name use japanese?

I confirmed using japanese a block's name at commit 4bbbbc6df1c5dd0b6dab78eefea9c619bfd020f5 on gh-pages branch


App is having trouble loading the extra_streamlit_components

Hello,
We are very keen on looking at the read-cookies and tabs features, but we are facing this error on any Streamlit version (we have tested on Streamlit 0.83.0-0.89.0 and extra_components 0.1.42-0.1.43).

Code

import streamlit as st
import extra_streamlit_components as stx
cookie_manager = stx.CookieManager()

Error:

Your app is having trouble loading the extra_streamlit_components.CookieManager.cookie_manager component.
(The app is attempting to load the component from , and hasn't received its "streamlit:componentReady" message.)
If this is a development build, have you started the dev server?
If this is a release build, have you compiled the frontend?
For more troubleshooting help, please see the Streamlit Component docs or visit our forums.

The issue couldn't be reproduced.
Please make sure the package's files weren't edited as this might have caused the problem.

Right. Thank you for confirming.
I will run a test today outside of Docker (wil try purely on Mac vitual env.), just to see the impact there.
The caveat we have now is that we mount Streamlit apps on the /. Perhaps that causes the issue.

Hi Mohamed,
Just got to the bottom of the problem.
Turns out that serving apps with components on http(s)://<host>/<app> is fine.
The problem is the Ingress controller in Kubernetes and that it sets the x-frame-options header to DENY by default.
After changing that to sameorigin - Streamlit components are loading correctly.
Just thought it's worth sharing with you.

Great conclusion Alchemication, sure will help someone out there!

@marduk2
Can you refer to previous any previous commit and issue a PR including the requested change? I would gladly approve and merge it.

Is this issue resolved? I am facing this issue intermittently and this goes off when navigated to another page


consider moving all internal tables to an internal namespace

We already namespace tables like mudstore:schema, it'd be great to do the same treatment to NamespaceOwner, InstalledModules, etc. I wouldn't mind these living together under a mud or mudinternal namespace or creating namespaces for each type of thing, e.g. mudstore, mudworld.
Ultimately my goal is to clear the root namespace for users and to make it a bit easier for us+users to know when they're looking at user-defined things vs mud-internal things.

depends on https://github.com/latticexyz/mud/issues/734 (world systems need to retain root namespace)

world systems need to retain root namespace

why?

root methods get registered with just their name
non-root methods get prefixed with the namespace
so I assume we want short method names like grantAccess, not mudnamespace_grantAccess for all the core API
and unlike tables, the internal system API is not quite as useless to end-users, not quite as distracting on the frontend (maybe)

I know that access control is somewhat tied to the function selector pattern (to determine namespace etc without an extra lookup) but I wonder if there's some special treatment we could do to world methods where we get best of both worlds (namespaced internal tables, non-namespaced world methods like grantAccess),

since we register all tables and systems in the CoreModule, it should be easy to move their mud config namespace to eg world and still register the system function selectors in the root namespace, and give the systems access to the world namespace.

I just took a stab at this and it's going to be a bit more involved than initially expected. Once I added a namespace to World's MUD config, it prefixed all systems with that namespace, thus changing the interfaces, which bubbles up to IBaseWorld, which a bunch of internal stuff uses.
Some possible next steps:

add namespace support/overrides to config for tables (see #994)
separate MUD configs (we'd need to add support for this)
don't use codegen for world systems?


SQLite may return LOCKED error even for read requests

Scenario:
goroutine A is creating a file under test
goroutine B calls readdir of test
The readdir may fail with error message: database is locked
refs: https://www2.sqlite.org/cvstrac/wiki?p=DatabaseIsLocked

Fixed by #2073